-- Logs begin at Sun 2022-10-23 01:33:25 UTC, end at Sun 2022-10-23 02:32:42 UTC. -- Oct 23 02:02:49.274968 dv-cinder-861491-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 23 02:02:49.284753 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 02:02:49 2022] *** Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: nodename: dv-cinder-861491-5-iscsi Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: machine: x86_64 Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: clock source: unix Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: pcre jit disabled Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: detected number of CPU cores: 4 Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: current working directory: / Oct 23 02:02:49.286744 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: detected binary path: /usr/bin/uwsgi-core Oct 23 02:02:49.287349 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: your processes number limit is 47680 Oct 23 02:02:49.287349 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: your memory page size is 4096 bytes Oct 23 02:02:49.287349 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: detected max file descriptor number: 2048 Oct 23 02:02:49.287349 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: lock engine: pthread robust mutexes Oct 23 02:02:49.287349 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: thunder lock: enabled Oct 23 02:02:49.287349 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 23 02:02:49.287349 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 02:02:49.326336 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: Python main interpreter initialized at 0x5627788909c0 Oct 23 02:02:49.326336 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: python threads support enabled Oct 23 02:02:49.326336 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: your server socket listen backlog is limited to 100 connections Oct 23 02:02:49.326336 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: your mercy for graceful operations on workers is 90 seconds Oct 23 02:02:49.326715 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 02:02:49.326794 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: *** Operational MODE: preforking *** Oct 23 02:02:49.327020 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: *** uWSGI is running in multiple interpreter mode *** Oct 23 02:02:49.327020 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: spawned uWSGI master process (pid: 103887) Oct 23 02:02:49.327211 dv-cinder-861491-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 23 02:02:49.328577 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: spawned uWSGI worker 1 (pid: 103888, cores: 1) Oct 23 02:02:49.328577 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: spawned uWSGI worker 2 (pid: 103889, cores: 1) Oct 23 02:02:49.328577 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 02:02:49.993499 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 02:02:50.006148 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 02:02:51.073880 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 02:02:51.073880 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: from cryptography.utils import int_from_bytes Oct 23 02:02:51.074489 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 02:02:51.074489 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: from cryptography.utils import int_from_bytes Oct 23 02:02:51.100697 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 02:02:51.100697 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: from cryptography.utils import int_from_bytes Oct 23 02:02:51.101171 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 02:02:51.101171 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: from cryptography.utils import int_from_bytes Oct 23 02:02:53.579777 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 02:02:53.580326 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 02:02:53.580554 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 02:02:53.580920 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 02:02:53.581176 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 02:02:53.581563 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.581888 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.582210 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.582557 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.582889 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.583038 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 02:02:53.583388 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.583477 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 02:02:53.583556 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.583811 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.583906 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 02:02:53.584138 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.584223 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 02:02:53.584403 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.584509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 02:02:53.584715 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.584803 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.585037 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-5-iscsi {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.585129 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.585354 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.585453 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.585659 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.585752 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.585969 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.586062 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.586284 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.586386 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.586610 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.586708 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.586928 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.587013 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.587228 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.587325 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.587491 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.587719 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.587828 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.588361 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-5-iscsi {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.588970 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.589228 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.589540 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.589653 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.589876 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.590012 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.590188 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.590278 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.590517 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.590610 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.590821 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.590918 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.591140 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.591226 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.591444 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.591536 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.591751 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.591943 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.592146 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-5-iscsi {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.592292 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.592459 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.592558 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.592770 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.592855 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.593081 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.593165 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.593442 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.593536 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.593750 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.593835 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.594066 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.594154 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.594392 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.594555 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.594720 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.594817 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.595026 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.595132 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.595353 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.595444 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-5-iscsi {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.595673 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.595760 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.595991 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.596076 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.596305 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.596400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.596604 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.596710 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.596912 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.597004 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.597219 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.597305 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.597535 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.597622 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.597838 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.597931 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.598140 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.598234 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.598389 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.598547 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.598720 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.598864 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.599041 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.599179 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.599359 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.599493 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.599681 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.599790 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.599934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.600092 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.600231 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.600395 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.600495 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.600704 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.600803 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.601003 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.601099 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.601303 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.601394 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.601549 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.601676 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.601848 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.601980 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.602163 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.602282 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.602500 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.602722 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.602827 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.603038 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.603147 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.603285 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.603396 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.603598 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.603691 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.603911 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.603999 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.604871 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.605188 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.605352 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.605500 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.605668 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.605896 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.605991 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.606149 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.606280 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.606474 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.606615 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.606815 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.606916 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.607135 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.607220 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.607444 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.607529 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.607762 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.607856 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.608082 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.608168 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.608387 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.608472 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.608693 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.608787 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.608999 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.609085 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.609316 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.609400 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.609620 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.609705 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.609922 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.610006 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.610174 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.610299 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.610493 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.610596 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.610804 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.610898 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.611121 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.611206 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.611427 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.611516 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.611730 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.611816 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.612032 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.612125 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.612330 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.612414 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.612634 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.612732 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.612935 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.613035 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.613240 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.613328 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.613485 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.613569 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.613785 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.613880 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.614085 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.614178 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.614398 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.614529 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.614726 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.614866 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.615027 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.615114 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.615328 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.615420 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.615622 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.615716 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.615929 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.616022 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.616229 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.616322 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.616529 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.616624 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.616831 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.616925 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.617130 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.617221 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.617430 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.617523 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.617727 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.617811 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.618026 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.618116 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.618325 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.618427 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.618650 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.618739 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.618952 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.619035 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.619268 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.619354 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.619567 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.619651 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.619896 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.620211 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.620422 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.620509 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.620736 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.620830 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.621044 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.621129 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.621364 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.621450 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.621670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.621764 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.621968 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.622053 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.622269 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.622355 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.622594 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.622697 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.622896 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.622980 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.623193 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.623278 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.623491 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.623576 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.623792 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.623877 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.624100 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.624186 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.624396 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.624482 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.624698 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.624797 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.624998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.625085 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.625296 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.625380 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.625598 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.625697 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.625899 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.625984 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.626205 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.626298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.626530 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.626642 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.626834 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.626927 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.627134 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.627219 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.627432 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.627526 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.627727 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.627812 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.628039 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.628125 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.628353 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.628440 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.628654 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.628739 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.628955 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.629039 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.629254 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.629341 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.629566 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:02:53.629651 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.629893 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.629978 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.630211 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.630297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.630568 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.630657 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.630879 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.630973 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.631191 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.631281 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.631508 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.631593 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.631816 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.631976 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.632125 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.632221 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.632434 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.632519 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.632750 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.632834 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.633056 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.633141 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.633362 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.633459 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.633667 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.633765 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.633978 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.634071 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.634290 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.634385 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.634639 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.634737 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.634967 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.635103 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.635285 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.635426 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.635595 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.636028 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.636125 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.636347 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.636440 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.636660 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.636790 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.636980 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.637069 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.637291 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.637390 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.637600 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.637704 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.637916 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.638003 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.638227 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.638312 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.638566 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.638670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.638879 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.638966 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.639191 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.639276 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.639497 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.639591 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.639807 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.639895 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.640113 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.640199 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.640443 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.640541 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.640749 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.640837 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.641058 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.641142 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.641367 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.641460 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.641672 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.641757 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.641981 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.642065 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.642285 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.642372 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.642613 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.642711 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.642921 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.643020 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.643226 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.643313 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.643528 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.643613 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.643848 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.643935 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.644158 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.644251 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.644469 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.644553 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.644779 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.644872 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.645086 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.645180 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.645394 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.645480 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.645700 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.645793 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.646006 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.646090 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.646309 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.646392 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.646640 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.646737 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.646941 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.647025 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.647243 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.647329 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.647550 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.647643 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.647859 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.648011 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.648155 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.648248 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.648475 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.648574 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.648777 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.648862 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.649079 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.649163 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.649392 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.649480 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.649699 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.649782 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.650007 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.650091 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.650314 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.650401 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.650643 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.650771 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.651497 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.651587 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.651812 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.651968 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.652122 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.652364 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.652455 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.652689 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.652776 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.653000 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.653085 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.653306 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.653392 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.653626 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.653721 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.653930 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.654014 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.654234 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.654319 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.654573 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.654666 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.654884 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.654971 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.655224 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.655316 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.655534 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.655624 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.655843 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.655930 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.656145 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.656240 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.656449 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.656534 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.656753 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.656838 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.657057 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.657151 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.657360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.657452 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.657678 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.657764 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.657983 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.658077 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.658286 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.658371 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.658621 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.658710 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.658922 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.659020 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.659229 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.659315 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.659531 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.659623 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.659833 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.659921 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.660134 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.660225 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.660439 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.660525 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.660740 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.660828 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.661042 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.661129 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.661344 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.661429 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.661644 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.661731 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.661945 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.662030 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.662261 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.662346 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.662591 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.662682 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.662893 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.662987 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.663194 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.663280 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.663493 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.663580 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.663830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.663916 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.664134 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.664228 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.664445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.664530 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.664761 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.664846 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.665067 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.665162 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.665387 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.665550 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.665724 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.665876 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.666056 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.666189 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.666370 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.666590 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.666815 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.667197 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.667363 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.667530 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.667677 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.667844 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.667988 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.668156 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.668307 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.668467 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.668616 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.668777 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.668933 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.669095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.669243 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.669403 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.669562 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.669720 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.669870 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.670030 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.670186 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.670351 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.670513 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.670687 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.670827 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.671005 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.671162 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.671309 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.671572 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.671658 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.671890 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.671976 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.672210 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.672308 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.672517 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.672603 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.672829 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.672922 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.673136 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.673221 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.673442 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.673527 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.673748 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.673841 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.674051 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.674135 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.674355 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.674457 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.674684 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.674783 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.674995 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.675082 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.675300 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.675392 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.675608 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.675746 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.675911 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.676003 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.676216 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.676300 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.676515 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.676601 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.676823 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.676908 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.677128 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.677253 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.677434 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.677521 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.677742 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.677835 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.678047 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.678134 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.678358 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.678471 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.678689 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.678764 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.681405 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.681559 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.681690 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.681800 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.681920 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.682028 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.682133 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.682246 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.682353 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683059 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683183 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683304 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683413 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683526 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683633 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683736 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683840 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.683945 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684049 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684162 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684267 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684381 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684494 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684605 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684605 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684605 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.684906 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685009 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685120 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685224 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685335 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685440 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685542 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685645 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685756 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.685861 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686042 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686151 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686253 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686356 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686496 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686607 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686725 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686838 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.686942 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687045 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687148 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687250 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687362 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687569 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687672 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687774 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.687887 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.688480 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.688565 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.688643 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.688721 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.688813 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.688893 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.688982 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.688982 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.689123 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.689199 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.689284 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.689364 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.689440 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.689516 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.689675 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.689829 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.690016 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.690141 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.690336 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.690487 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.690694 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.690781 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.691020 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.691120 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.691334 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.691425 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.691641 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.691729 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.691951 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.692049 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.692255 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.692341 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.692555 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.692639 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.692860 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.692947 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.693160 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.693246 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.693464 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.693557 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.693767 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.693855 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.694077 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.694327 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.694415 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.694692 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.694789 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.694995 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.695080 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.695297 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.695383 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.695610 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.695708 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.695912 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.696008 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.696221 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.696308 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.696525 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.696619 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.696846 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.696941 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.697147 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.697232 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.697449 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.697535 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.698327 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.698617 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.698713 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.699040 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.699139 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.699350 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.699438 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.699687 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.699774 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.699994 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.700079 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.700301 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.700388 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.700613 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.700708 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.700917 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.701003 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.701221 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.701348 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.701524 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.701610 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.701826 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.701921 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.702127 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.702212 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.702426 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.702545 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.702756 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.702852 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.703058 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.703144 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.703367 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.703462 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.703672 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.703766 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.703973 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.704066 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.704275 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.704361 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.704575 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.704669 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.704885 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.704971 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.705188 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.705274 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.705502 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.705590 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.705810 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.705900 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.706113 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.706199 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.706414 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.706562 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.706746 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.706833 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.707055 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.707140 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.707355 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.707443 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.707654 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.707738 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.707954 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.708046 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.708260 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.708345 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.708561 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.708649 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.708859 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.709029 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.709159 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.709245 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.709463 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.709547 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.709767 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.709860 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.710068 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.710155 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.710367 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.710472 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.710700 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.710798 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.711001 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.711094 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.711308 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.711431 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.711614 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.711714 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.711914 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.711999 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.712211 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.712296 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.712519 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.712605 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.712821 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.713175 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.713441 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.713531 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.713755 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.714073 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.714233 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.714371 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.714571 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.714703 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.714898 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.715009 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.715210 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.715317 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.715519 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.715614 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.715825 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.715912 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.716143 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.716235 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.716457 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.716556 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.716760 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.716846 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.717083 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.717169 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.717388 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.717482 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.717690 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.717775 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.717991 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.718078 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.718293 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.718392 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.718620 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.718709 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.718924 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.719010 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.719237 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.719342 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.719555 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.719642 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.719868 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.719955 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.720170 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.720258 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.720478 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.720562 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.720778 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.720863 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.721081 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.721168 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.721382 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.721467 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.721688 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.721773 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.721988 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.722081 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.722288 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.722375 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.722611 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.722697 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.722912 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.722998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.723212 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.723304 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.723523 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.723607 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.723828 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.723915 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.724129 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.724214 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.724431 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.724528 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.724730 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.724816 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.725047 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.725131 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.725355 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.725452 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.725661 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.725746 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.725967 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.726056 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.726276 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.726380 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.726618 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.726719 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.726923 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.727009 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.727230 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.727324 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.727538 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.727623 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.727839 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.727927 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.728144 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.728230 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.728446 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.728530 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.728751 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.728825 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.729616 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.729734 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.729978 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.730303 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.730536 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.730648 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.730866 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.730955 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.731183 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.731269 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.731496 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.731580 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.731816 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.731903 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.732131 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.732214 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.732453 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.732547 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.732759 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.732845 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.733069 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.733154 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.733378 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.733478 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.733684 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.733770 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.733990 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.734077 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.734298 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.734393 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.734632 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.734728 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.734941 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.735027 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.735249 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.735344 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.735554 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.735647 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.735859 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.735946 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.736160 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.736263 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.736465 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.736551 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.736777 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.736862 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.737077 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.737164 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.737396 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.737482 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.737703 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.737796 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.738000 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.738086 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.738300 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.738386 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.738626 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.738714 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.738933 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.739022 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.739235 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.739321 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.739652 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.739748 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.739959 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.740044 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.740263 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.740347 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.740563 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.740662 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.740869 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.740957 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.741177 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.741263 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.741489 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.741584 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.741798 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.741885 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.742100 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.742185 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.742508 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.742608 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.742825 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.742921 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.743131 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.743219 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.743454 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.743581 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.743737 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.743823 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.744036 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.744122 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.744343 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.744430 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.744689 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.744779 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.745015 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.745339 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.745543 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.745638 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.745858 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.745954 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.746169 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.746358 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.746503 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.746705 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.746827 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.747017 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.747149 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.747341 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.747585 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.747673 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.747882 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.747990 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.748189 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.748275 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.748539 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.748632 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.748843 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.748966 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.749147 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.749237 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.749466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.749629 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.749781 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.749876 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.750074 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.750160 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.750383 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.750502 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.750717 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.750804 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.751021 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.751107 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.751324 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.751419 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.751642 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.751727 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.751948 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.752033 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.752258 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.752352 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.752562 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.752655 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.752878 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.752963 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.753197 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.753336 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.753499 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.753585 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.753814 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.753898 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.754120 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.754219 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.754422 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.754552 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.754747 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.754833 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.755050 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.755148 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.755391 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.755485 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.755695 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.755791 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.756014 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.756101 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.756331 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.756424 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.756640 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.756734 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.756941 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.757027 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.757259 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.757345 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.757560 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.757655 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.757865 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.757951 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.758170 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.758255 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.758496 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.758599 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.758799 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.758893 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.759099 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.759196 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.759401 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.759497 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.759701 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.759787 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.760001 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.760096 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.760837 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.761222 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.761308 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.761530 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.761691 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.761832 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.762058 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.762146 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.762399 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.762515 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.762758 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.762851 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.763063 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.763151 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.763382 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.763480 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.763691 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.763786 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.763994 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.764082 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.764296 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.764389 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.764596 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.764692 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.764932 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.765026 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.765234 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.765331 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.765557 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.765653 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.765865 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.765952 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.766187 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.766273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.766525 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.766627 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.766840 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.766927 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.767153 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.767239 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.767464 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.767559 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.767777 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.767863 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.768090 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.768176 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.768403 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.768492 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.768711 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.768797 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.769024 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.769156 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.769336 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.769427 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.769649 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.769735 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.769963 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.770171 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.770266 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.770530 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.770622 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.770849 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.770935 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.771164 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.771253 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.771479 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.771565 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.771792 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.771878 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.772106 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.772194 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.772424 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.772511 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.772735 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.772821 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.773045 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.773135 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.773354 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.773440 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.773680 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.773777 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.774000 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.774087 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.774324 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.774410 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.774683 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.774787 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.775002 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.775096 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.775316 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.775411 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.775630 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.775730 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.776492 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.776633 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.776900 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.777057 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.777384 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.777472 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.777696 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.777782 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.778014 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.778099 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.778334 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.778421 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.778676 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.778773 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.778991 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.779077 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.779303 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.779526 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.779613 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.779862 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.779950 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.780183 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.780350 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.780504 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.780599 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.780819 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.780904 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.781133 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.781221 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.781450 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.781536 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.781770 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.781865 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.782085 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.782225 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.782404 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.782744 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.782829 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.783063 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.783162 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.783425 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.783580 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.783752 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.783896 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.784082 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.784229 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.784424 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.784555 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.784745 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.784878 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.785064 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.785196 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.785384 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.785514 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.785700 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.785839 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.786061 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.786159 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.786380 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.786495 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.786720 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.786820 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.787039 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.787133 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.787343 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.787430 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.787658 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.787753 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.787966 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.788052 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.788267 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.788362 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.788580 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.788666 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.788885 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.788970 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.789195 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.789414 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.789509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.789761 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.789848 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.790077 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.790163 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.790402 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.790526 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.790752 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.790839 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.791070 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.791157 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.791378 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.791474 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.791762 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.791900 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.792081 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.792214 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.792528 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.792618 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.792847 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.792933 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.793158 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.793245 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.793462 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.793551 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.793767 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.793853 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.794078 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.794164 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.794387 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.794522 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.794716 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.794803 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.795027 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.795125 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.795333 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.795421 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.795657 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.795744 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.795963 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.796058 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.796269 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.796355 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.796573 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.796660 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.796882 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.796976 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.797187 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.797276 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.797488 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.797573 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.797792 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.797887 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.798096 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.798323 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.798410 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.798697 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.798784 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.799014 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.799108 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.799315 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.799439 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.799626 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.799721 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.799952 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.800045 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.800260 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.800346 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.800561 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.800657 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.800876 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.800961 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.801176 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.801263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.801481 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.801580 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.801796 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.801882 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.802100 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.802186 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.802406 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.802538 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.802741 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.802828 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.803049 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.803136 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.803352 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.803440 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.803661 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.803747 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.803961 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.804275 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.804370 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.804576 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.804662 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.804880 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.804966 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.805184 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.805279 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.805494 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.805581 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.805798 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.805885 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.806100 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.806195 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.806402 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.806508 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.806730 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.806828 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.807039 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.807167 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.807374 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.807470 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.807684 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.807904 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.808000 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.808226 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.808313 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.808541 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.808628 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.808855 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.808950 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.809168 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.809254 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.809480 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.809576 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.809786 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.809875 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.810088 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.810176 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.810399 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.810515 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.810733 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.810821 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.811042 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.811135 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.811351 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.811445 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.811664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.811751 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.812001 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.812086 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.812316 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.812401 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.812640 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.812846 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.812957 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.813181 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.813267 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.813501 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.813600 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.813833 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.813920 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.814159 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.814244 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.814486 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.814577 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.814797 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.814894 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.815102 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.815188 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.815422 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.815509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.815725 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.815813 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.816037 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.816349 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.816434 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.816661 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.816747 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.816973 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.817065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.817283 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.817370 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.817592 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.817678 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.817902 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.817987 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.818211 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.818299 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.818549 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.818636 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.818861 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.818958 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.819172 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.819259 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.819478 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.819565 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.819787 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.819882 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.820100 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.820186 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.820437 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.820523 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.820740 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.820834 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.821044 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.821131 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.821350 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.821438 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.821661 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.821749 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.821968 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.822052 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.822276 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.822363 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.822613 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.823227 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.823453 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.823562 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.823772 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.823968 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.824100 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.824280 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.824415 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.824589 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.824722 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.824896 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.825203 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.825404 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.825514 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.825725 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.825811 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.826050 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.826139 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.826373 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.826480 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.826716 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.826803 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.827019 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.827107 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.827323 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.827420 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.827634 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.827721 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.827938 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.828034 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.828242 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.828329 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.828548 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.828644 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.828851 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.828938 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.829153 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.829239 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.829482 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.829578 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.829857 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.829952 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.830118 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.830212 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.830421 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.830557 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.830754 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.830849 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.831071 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.831157 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.831380 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.831475 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.831688 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.831819 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.831991 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.832077 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.832300 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.832395 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.832603 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.832727 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.832907 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.832994 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.833210 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.833298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.833512 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.833599 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.833820 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.833907 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.834121 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.834209 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.834424 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.834532 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.834757 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.834843 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.835084 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.835173 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.835394 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.835479 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.835697 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.835792 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.836005 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.836092 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.836309 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.836405 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.836612 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.836707 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.836912 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.836998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.837214 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.837300 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.837515 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.837610 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.838092 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.838191 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.838971 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.839074 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.839298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.839399 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.839612 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.839762 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.839922 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.840079 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.840240 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.840404 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.840535 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.840717 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.840846 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.841040 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.841162 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.841364 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.841479 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.841686 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.841806 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.841997 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.842132 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.842329 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.842480 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.842667 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.842785 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.842978 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.843115 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.843289 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.843458 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.843599 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.843771 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.843910 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.844111 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.844205 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.844440 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.844535 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.844753 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.844849 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.845065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.845161 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.845368 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.845455 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.845613 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 02:02:53.845752 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.846072 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.846388 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.846742 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.847071 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.847383 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.847690 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.848000 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.848309 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.848617 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.848930 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.849238 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.849545 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.849862 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.850177 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.850525 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.850853 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.851163 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.851487 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.851817 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.852163 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.852475 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.852817 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.853145 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.853458 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.853767 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.854129 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:02:53.854379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 02:02:53.998434 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO dbcounter [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Registered counter for database nova_api Oct 23 02:02:54.006635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO dbcounter [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Registered counter for database nova_api Oct 23 02:02:54.020432 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_db.sqlalchemy.engines [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:02:54.027314 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_db.sqlalchemy.engines [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:02:54.027780 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writer thread running {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:02:54.033751 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writer thread running {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:02:54.084061 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.context [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9a91453-b148-423b-846a-e9f010e30c38(cell1) {{(pid=103888) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 02:02:54.088114 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:02:54.088967 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:02:54.090375 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:02:54.090818 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.context [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9a91453-b148-423b-846a-e9f010e30c38(cell1) {{(pid=103889) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 02:02:54.091109 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:02:54.091556 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:02:54.093526 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:02:54.094612 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_concurrency.lockutils [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:02:54.095088 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_concurrency.lockutils [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:02:54.095528 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO dbcounter [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Registered counter for database nova_cell0 Oct 23 02:02:54.096673 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_concurrency.lockutils [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:02:54.097382 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_concurrency.lockutils [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:02:54.097834 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_concurrency.lockutils [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:02:54.099653 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO dbcounter [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Registered counter for database nova_cell1 Oct 23 02:02:54.099840 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_concurrency.lockutils [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:02:54.101795 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO dbcounter [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Registered counter for database nova_cell0 Oct 23 02:02:54.106016 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO dbcounter [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Registered counter for database nova_cell1 Oct 23 02:02:54.107115 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_db.sqlalchemy.engines [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:02:54.109005 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_db.sqlalchemy.engines [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:02:54.113174 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_db.sqlalchemy.engines [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:02:54.115060 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_db.sqlalchemy.engines [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:02:54.115307 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writer thread running {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:02:54.116743 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writer thread running {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:02:54.121046 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writer thread running {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:02:54.126310 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writer thread running {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:02:54.260170 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO dbcounter [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Registered counter for database nova_cell0 Oct 23 02:02:54.267792 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO dbcounter [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Registered counter for database nova_cell0 Oct 23 02:02:54.268987 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_db.sqlalchemy.engines [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:02:54.273781 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writer thread running {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:02:54.276946 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG oslo_db.sqlalchemy.engines [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:02:54.281920 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writer thread running {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:02:54.613459 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: WARNING keystonemiddleware.auth_token [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 02:02:54.619946 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: WARNING keystonemiddleware.auth_token [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 02:02:54.620850 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: WARNING keystonemiddleware.auth_token [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 02:02:54.627210 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: WARNING keystonemiddleware.auth_token [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 02:02:54.965660 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: WARNING keystonemiddleware.auth_token [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 02:02:54.970609 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: WARNING keystonemiddleware.auth_token [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 02:02:54.971572 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: WARNING keystonemiddleware.auth_token [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 02:02:54.976541 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: WARNING keystonemiddleware.auth_token [None req-4fae8008-c8e4-4623-8b62-ef0e6455dc2e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 02:02:54.976842 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5627788909c0 pid: 103888 (default app) Oct 23 02:02:54.979021 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:02:54.980262 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001885 Oct 23 02:02:54.980677 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Sun Oct 23 02:02:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:02:54.981875 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5627788909c0 pid: 103889 (default app) Oct 23 02:04:16.548261 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:16.549189 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 23 02:04:16.550169 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:04:16.562904 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writing DB stats nova_api:SELECT=3 {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:16.564479 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writing DB stats nova_cell0:SELECT=3 {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:16.566189 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writing DB stats nova_cell1:SELECT=3 {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:16.567571 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:17.462642 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-e9a100d3-06fa-4fd1-8faa-c079828b63bf admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:17.495068 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-e9a100d3-06fa-4fd1-8faa-c079828b63bf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.937937 Oct 23 02:04:17.495801 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 23 02:04:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:20.136197 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:20.137350 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-3202e7f2-7457-4b9e-a93d-4a94bf417860 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 23 02:04:20.138046 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:20.604833 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-c54dc773-19b2-44f8-88b2-8eaa4d7ed179 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "ram": 256, "swap": 0}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:20.652049 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-c54dc773-19b2-44f8-88b2-8eaa4d7ed179 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.506789 Oct 23 02:04:20.652619 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:04:20.666378 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_api:SELECT=3 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:20.667208 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_cell1:SELECT=3 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:20.669102 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_cell0:SELECT=3 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:20.669830 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:20.880244 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-1630d936-e094-4f78-a568-421ada4d4616 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:20.949123 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-1630d936-e094-4f78-a568-421ada4d4616 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286849 Oct 23 02:04:20.949123 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 23 02:04:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:23.616005 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-c54dc773-19b2-44f8-88b2-8eaa4d7ed179 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:23.617020 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-c54dc773-19b2-44f8-88b2-8eaa4d7ed179 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 23 02:04:23.617422 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:24.286977 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-eaa5710b-1dd5-4aa8-8258-6e9782c902ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "ram": 512, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:24.326193 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-eaa5710b-1dd5-4aa8-8258-6e9782c902ff admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702543 Oct 23 02:04:24.326786 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 02:04:24.340883 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-e8724c2e-4094-4606-971b-7c895e9fe796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:24.384766 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-e8724c2e-4094-4606-971b-7c895e9fe796 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048696 Oct 23 02:04:24.385474 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 23 02:04:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:27.013294 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-eaa5710b-1dd5-4aa8-8258-6e9782c902ff admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:27.014308 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-eaa5710b-1dd5-4aa8-8258-6e9782c902ff admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 23 02:04:27.014756 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:27.438361 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-7aecdc5d-ac8c-4994-af65-84722e53d98b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:27.461875 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-7aecdc5d-ac8c-4994-af65-84722e53d98b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439808 Oct 23 02:04:27.462418 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:04:27.475911 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-b38438d3-ff34-44e9-89fc-d2d0c223304c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:27.507240 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-b38438d3-ff34-44e9-89fc-d2d0c223304c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034873 Oct 23 02:04:27.508015 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 23 02:04:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:30.162901 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-7aecdc5d-ac8c-4994-af65-84722e53d98b admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:30.163935 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-7aecdc5d-ac8c-4994-af65-84722e53d98b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 23 02:04:30.164337 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:30.585022 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-a9e8f9f2-b86d-4d96-8d5c-5a39377532e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "id": "d3"}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:30.606777 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-a9e8f9f2-b86d-4d96-8d5c-5a39377532e0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435811 Oct 23 02:04:30.610280 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:04:30.620731 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-c2448751-6eee-4f12-8760-59da5898f571 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:30.650267 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-c2448751-6eee-4f12-8760-59da5898f571 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033682 Oct 23 02:04:30.653871 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 23 02:04:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:33.340605 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-a9e8f9f2-b86d-4d96-8d5c-5a39377532e0 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:33.341577 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-a9e8f9f2-b86d-4d96-8d5c-5a39377532e0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 23 02:04:33.341970 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:33.767511 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-72b3bb45-a902-43f2-a31c-64f5ef5f42cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:33.790613 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-72b3bb45-a902-43f2-a31c-64f5ef5f42cf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442120 Oct 23 02:04:33.791436 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:04:33.804573 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-0fc812f4-cd44-41f5-a61a-842e2b75c44d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:33.832508 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-0fc812f4-cd44-41f5-a61a-842e2b75c44d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032213 Oct 23 02:04:33.833083 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Sun Oct 23 02:04:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:36.728001 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-72b3bb45-a902-43f2-a31c-64f5ef5f42cf admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:36.729386 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-72b3bb45-a902-43f2-a31c-64f5ef5f42cf admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001890 Oct 23 02:04:36.729944 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:37.158829 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-0bc1f2e9-6eb2-43a5-b530-1114a1b59484 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:37.187460 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-0bc1f2e9-6eb2-43a5-b530-1114a1b59484 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.449759 Oct 23 02:04:37.188684 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 23 02:04:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:04:40.051609 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-72b3bb45-a902-43f2-a31c-64f5ef5f42cf admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:40.052621 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-72b3bb45-a902-43f2-a31c-64f5ef5f42cf admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 23 02:04:40.053024 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:40.450042 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-39b2fe51-7eaa-4709-888d-2748bc8421f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:40.470358 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-39b2fe51-7eaa-4709-888d-2748bc8421f3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.411254 Oct 23 02:04:40.470933 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 02:04:40.482933 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-f9e6aa7c-0728-4574-b5ab-4df95fbef21b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:40.509766 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-f9e6aa7c-0728-4574-b5ab-4df95fbef21b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030589 Oct 23 02:04:40.510343 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 23 02:04:40 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:43.125017 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-39b2fe51-7eaa-4709-888d-2748bc8421f3 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:43.126719 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-39b2fe51-7eaa-4709-888d-2748bc8421f3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Oct 23 02:04:43.127149 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:43.516625 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-9339f225-d7e4-44f8-b335-0a577d3abe71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:43.539436 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-9339f225-d7e4-44f8-b335-0a577d3abe71 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.405934 Oct 23 02:04:43.540250 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:04:43.555562 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-f412e545-bab1-4d93-b60c-6c603459503f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:43.616219 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-f412e545-bab1-4d93-b60c-6c603459503f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066631 Oct 23 02:04:43.617341 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 23 02:04:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:46.258545 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-9339f225-d7e4-44f8-b335-0a577d3abe71 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:46.259493 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-9339f225-d7e4-44f8-b335-0a577d3abe71 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 23 02:04:46.259892 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:46.743938 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-e4c092b6-a4c5-457c-8b57-82fdf7df18c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "name": "m1.medium", "disk": 40, "vcpus": 2, "ram": 4096}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:46.766804 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-e4c092b6-a4c5-457c-8b57-82fdf7df18c0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.499222 Oct 23 02:04:46.767354 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:04:46.782353 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-c1906f55-a0f4-4bb9-a0e0-be1ba27fee2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:46.787330 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:46.817500 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-c1906f55-a0f4-4bb9-a0e0-be1ba27fee2b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041590 Oct 23 02:04:46.818177 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 23 02:04:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:49.461405 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-e4c092b6-a4c5-457c-8b57-82fdf7df18c0 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:49.462417 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-e4c092b6-a4c5-457c-8b57-82fdf7df18c0 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 23 02:04:49.463040 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:49.923162 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-a6e52496-c628-4a6a-aaa1-287c14dca78d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "vcpus": 4, "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:49.943946 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-a6e52496-c628-4a6a-aaa1-287c14dca78d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474473 Oct 23 02:04:49.944774 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 02:04:49.957950 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-1f208c27-3ec0-4b0d-af5c-b8f585a4d2ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:49.983989 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-1f208c27-3ec0-4b0d-af5c-b8f585a4d2ff admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030961 Oct 23 02:04:49.985259 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 23 02:04:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:04:52.695871 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-a6e52496-c628-4a6a-aaa1-287c14dca78d admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:04:52.697470 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-a6e52496-c628-4a6a-aaa1-287c14dca78d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Oct 23 02:04:52.698285 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:04:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:04:53.148430 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-7e77aa42-158a-42d7-ab07-b8743f471981 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "swap": 0}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:53.154840 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:04:53.175998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-7e77aa42-158a-42d7-ab07-b8743f471981 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.470617 Oct 23 02:04:53.176895 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Sun Oct 23 02:04:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:04:53.188935 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-a5283f38-be39-4cb4-8b25-b7dd584f4157 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:04:53.220986 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-a5283f38-be39-4cb4-8b25-b7dd584f4157 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035785 Oct 23 02:04:53.230915 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Sun Oct 23 02:04:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:05:09.469509 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-7e77aa42-158a-42d7-ab07-b8743f471981 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:09.470569 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-7e77aa42-158a-42d7-ab07-b8743f471981 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 23 02:05:09.470971 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:09.481427 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:05:09.862046 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-32160d17-adf4-42b2-9bd6-17d1a8952356 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:09.880338 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-32160d17-adf4-42b2-9bd6-17d1a8952356 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403285 Oct 23 02:05:09.880872 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 23 02:05:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:05:11.185170 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-7e77aa42-158a-42d7-ab07-b8743f471981 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:11.186176 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-7e77aa42-158a-42d7-ab07-b8743f471981 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Oct 23 02:05:11.186603 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:05:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:11.706110 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-ae6af956-81ef-4741-9c48-5b58bdc1814f admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:11.711443 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.wsgi [None req-ae6af956-81ef-4741-9c48-5b58bdc1814f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-ae6af956-81ef-4741-9c48-5b58bdc1814f admin admin] Request method failure captured: Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Accept: application/json Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Accept-Encoding: gzip, deflate Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Connection: keep-alive Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Content-Length: 0 Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Host: 10.222.0.23 Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Openstack-Api-Version: compute 2.92 Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Openstack-System-Scope: None Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: User-Agent: python-novaclient Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Auth-Token: gAAAAABjVKFXuamRCpvRGRhwI1TmCV8NnlkArBKgjqvuDhPyslCvUVHEPZ4dtgy_pl3lX2eiG6Lj8BhTYAfdC3GWsYgXHW9h9PtJmzzAyNoCqTT-0Qno6-sJGr5YenOhaPlwFQ3rFhFed5zJaIRNSeLMgrJVEYuo7TrGrnU5W0vZDlNWHJttyIc Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Domain-Id: None Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Domain-Name: None Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Identity-Status: Confirmed Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Is-Admin-Project: True Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Domain-Id: default Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Domain-Name: Default Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Name: admin Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Role: reader,admin,member Oct 23 02:05:11.714635 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Roles: reader,admin,member Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab10d627c6844be3824524caf5053de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab10d627c6844be3824524caf5053de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant: admin Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant-Name: admin Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User: admin Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Domain-Id: default Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Domain-Name: Default Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Id: ef10648b88704f08acf4b18d8fe4cfac Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Name: admin Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: method: > Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: exception: Flavor 42 could not be found. Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: action_args: {'id': '42'} Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:05:11.716263 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:11.717273 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.718664 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-ae6af956-81ef-4741-9c48-5b58bdc1814f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:05:11.719919 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-ae6af956-81ef-4741-9c48-5b58bdc1814f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393855 Oct 23 02:05:11.719919 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 23 02:05:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:11.726166 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-75936561-347f-4489-9401-f4bd5d4a9ae8 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:11.749228 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-75936561-347f-4489-9401-f4bd5d4a9ae8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026614 Oct 23 02:05:11.749768 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 23 02:05:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:05:11.760200 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-d0c34ffa-32b9-4dc6-9136-4720fcb99f75 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:11.782786 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-d0c34ffa-32b9-4dc6-9136-4720fcb99f75 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026869 Oct 23 02:05:11.783308 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 23 02:05:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:05:11.792488 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-0ea48902-40b6-4d0e-9e5e-f2394a8ed275 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:11.798276 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.wsgi [None req-0ea48902-40b6-4d0e-9e5e-f2394a8ed275 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-0ea48902-40b6-4d0e-9e5e-f2394a8ed275 admin admin] Request method failure captured: Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Accept: application/json Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Accept-Encoding: gzip, deflate Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Connection: keep-alive Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Content-Length: 0 Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Host: 10.222.0.23 Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Openstack-Api-Version: compute 2.92 Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Openstack-System-Scope: None Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: User-Agent: python-novaclient Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Auth-Token: gAAAAABjVKFXuamRCpvRGRhwI1TmCV8NnlkArBKgjqvuDhPyslCvUVHEPZ4dtgy_pl3lX2eiG6Lj8BhTYAfdC3GWsYgXHW9h9PtJmzzAyNoCqTT-0Qno6-sJGr5YenOhaPlwFQ3rFhFed5zJaIRNSeLMgrJVEYuo7TrGrnU5W0vZDlNWHJttyIc Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Domain-Id: None Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Domain-Name: None Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Identity-Status: Confirmed Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Is-Admin-Project: True Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Domain-Id: default Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Domain-Name: Default Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Name: admin Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Role: reader,admin,member Oct 23 02:05:11.801533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Roles: reader,admin,member Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab10d627c6844be3824524caf5053de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab10d627c6844be3824524caf5053de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant: admin Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant-Name: admin Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User: admin Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Domain-Id: default Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Domain-Name: Default Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Id: ef10648b88704f08acf4b18d8fe4cfac Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Name: admin Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: method: > Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: exception: Flavor 42 could not be found. Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: action_args: {'id': '42'} Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:05:11.803095 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:11.804065 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:11.805298 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-0ea48902-40b6-4d0e-9e5e-f2394a8ed275 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:05:11.806520 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-0ea48902-40b6-4d0e-9e5e-f2394a8ed275 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013992 Oct 23 02:05:11.806520 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 23 02:05:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:12.999317 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-d0c34ffa-32b9-4dc6-9136-4720fcb99f75 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:13.000332 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-d0c34ffa-32b9-4dc6-9136-4720fcb99f75 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 23 02:05:13.000727 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:05:13.520986 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-e7df311f-5cc6-4bdc-a16c-586f3f15ffda admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:13.525914 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.wsgi [None req-e7df311f-5cc6-4bdc-a16c-586f3f15ffda admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-e7df311f-5cc6-4bdc-a16c-586f3f15ffda admin admin] Request method failure captured: Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Accept: application/json Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Accept-Encoding: gzip, deflate Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Connection: keep-alive Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Content-Length: 0 Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Host: 10.222.0.23 Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Openstack-Api-Version: compute 2.92 Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Openstack-System-Scope: None Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: User-Agent: python-novaclient Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Auth-Token: gAAAAABjVKFYvGbAMzCVp9rOFePwmyXUzM_0zeRgD9mkqP714YBWbcMRMtZZ_0nOki4VeliAjX__TgvqsYoTJmpTIwi2Uo1xgjQhh8YDbEtlhtugYD7f1YYhkOdUzkaD8o0qh4oa5leQNNWKJB8qRlPY13EJ1X5JjhNh5SqA00lsSO07moO_9e8 Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Domain-Id: None Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Domain-Name: None Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Identity-Status: Confirmed Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Is-Admin-Project: True Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Domain-Id: default Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Domain-Name: Default Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Name: admin Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Role: reader,admin,member Oct 23 02:05:13.527447 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Roles: reader,admin,member Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab10d627c6844be3824524caf5053de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab10d627c6844be3824524caf5053de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant: admin Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant-Name: admin Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User: admin Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Domain-Id: default Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Domain-Name: Default Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Id: ef10648b88704f08acf4b18d8fe4cfac Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Name: admin Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: method: > Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: exception: Flavor 84 could not be found. Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: action_args: {'id': '84'} Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:05:13.529445 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:13.530400 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.531998 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-e7df311f-5cc6-4bdc-a16c-586f3f15ffda admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:05:13.533179 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-e7df311f-5cc6-4bdc-a16c-586f3f15ffda admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389504 Oct 23 02:05:13.533179 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 23 02:05:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:13.538977 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-4c29cbc6-f93a-46fd-b463-5d0a2da8a3f8 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:13.554469 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-4c29cbc6-f93a-46fd-b463-5d0a2da8a3f8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018934 Oct 23 02:05:13.554931 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 23 02:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:05:13.564206 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-57ee682b-5ddc-46c7-9c16-a6d0dad097c9 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:13.580299 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-57ee682b-5ddc-46c7-9c16-a6d0dad097c9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019627 Oct 23 02:05:13.580836 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 23 02:05:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:05:13.589843 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-53a1be47-2b52-493a-87f6-565d84053617 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:13.595335 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.wsgi [None req-53a1be47-2b52-493a-87f6-565d84053617 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-53a1be47-2b52-493a-87f6-565d84053617 admin admin] Request method failure captured: Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Accept: application/json Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Accept-Encoding: gzip, deflate Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Connection: keep-alive Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Content-Length: 0 Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Host: 10.222.0.23 Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Openstack-Api-Version: compute 2.92 Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Openstack-System-Scope: None Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: User-Agent: python-novaclient Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Auth-Token: gAAAAABjVKFYvGbAMzCVp9rOFePwmyXUzM_0zeRgD9mkqP714YBWbcMRMtZZ_0nOki4VeliAjX__TgvqsYoTJmpTIwi2Uo1xgjQhh8YDbEtlhtugYD7f1YYhkOdUzkaD8o0qh4oa5leQNNWKJB8qRlPY13EJ1X5JjhNh5SqA00lsSO07moO_9e8 Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Domain-Id: None Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Domain-Name: None Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Identity-Status: Confirmed Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Is-Admin-Project: True Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Domain-Id: default Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Domain-Name: Default Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Name: admin Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Role: reader,admin,member Oct 23 02:05:13.596830 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Roles: reader,admin,member Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab10d627c6844be3824524caf5053de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab10d627c6844be3824524caf5053de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant: admin Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant-Name: admin Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User: admin Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Domain-Id: default Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Domain-Name: Default Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Id: ef10648b88704f08acf4b18d8fe4cfac Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Name: admin Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: method: > Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: exception: Flavor 84 could not be found. Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: action_args: {'id': '84'} Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:05:13.598379 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:13.599391 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:13.600509 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-53a1be47-2b52-493a-87f6-565d84053617 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:05:13.601574 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-53a1be47-2b52-493a-87f6-565d84053617 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011822 Oct 23 02:05:13.601574 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Sun Oct 23 02:05:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:14.815052 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-57ee682b-5ddc-46c7-9c16-a6d0dad097c9 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:14.816112 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-57ee682b-5ddc-46c7-9c16-a6d0dad097c9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 23 02:05:14.816508 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:15.338764 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-45fa606f-4960-48ce-8daf-fffaa9bbc180 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:15.344551 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.wsgi [None req-45fa606f-4960-48ce-8daf-fffaa9bbc180 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-45fa606f-4960-48ce-8daf-fffaa9bbc180 admin admin] Request method failure captured: Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Accept: application/json Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Accept-Encoding: gzip, deflate Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Connection: keep-alive Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Content-Length: 0 Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Host: 10.222.0.23 Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Openstack-Api-Version: compute 2.92 Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Openstack-System-Scope: None Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: User-Agent: python-novaclient Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Auth-Token: gAAAAABjVKFa9m95jYPwqINSlh0w_h_gQBiUd1feYeg6nh-QiS-f2OEc-Za-siROC2qFOgzf3eZBQc22TM0W58lPAqKDnQ-wMHdt6cyvVMQQPAh7PQWSuM5eAGiE6YTNgErga8G0c5NYk10-9b3_2bUmtH--cJnM9P0wo0OAgyLnm9DKEVqzxZU Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Domain-Id: None Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Domain-Name: None Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Identity-Status: Confirmed Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Is-Admin-Project: True Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Domain-Id: default Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Domain-Name: Default Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Project-Name: admin Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Role: reader,admin,member Oct 23 02:05:15.346041 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Roles: reader,admin,member Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab10d627c6844be3824524caf5053de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab10d627c6844be3824524caf5053de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant: admin Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-Tenant-Name: admin Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User: admin Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Domain-Id: default Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Domain-Name: Default Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Id: ef10648b88704f08acf4b18d8fe4cfac Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: X-User-Name: admin Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: method: > Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: exception: Flavor 451 could not be found. Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: action_args: {'id': '451'} Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:05:15.347670 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:15.348757 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.350297 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-45fa606f-4960-48ce-8daf-fffaa9bbc180 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:05:15.351507 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-45fa606f-4960-48ce-8daf-fffaa9bbc180 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392132 Oct 23 02:05:15.351507 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 23 02:05:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 23 02:05:15.358114 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-bd687700-8960-4dd0-95cd-2f5f6b8dd5e4 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:15.373547 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-bd687700-8960-4dd0-95cd-2f5f6b8dd5e4 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019892 Oct 23 02:05:15.374063 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 23 02:05:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:05:15.383687 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:15.398320 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018213 Oct 23 02:05:15.398873 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Sun Oct 23 02:05:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:05:15.408469 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-40025188-7bde-4483-8a98-d3fc8e23169d admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:15.413364 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.wsgi [None req-40025188-7bde-4483-8a98-d3fc8e23169d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-40025188-7bde-4483-8a98-d3fc8e23169d admin admin] Request method failure captured: Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Accept: application/json Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Accept-Encoding: gzip, deflate Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Connection: keep-alive Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Content-Length: 0 Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Host: 10.222.0.23 Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Openstack-Api-Version: compute 2.92 Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Openstack-System-Scope: None Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: User-Agent: python-novaclient Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Auth-Token: gAAAAABjVKFa9m95jYPwqINSlh0w_h_gQBiUd1feYeg6nh-QiS-f2OEc-Za-siROC2qFOgzf3eZBQc22TM0W58lPAqKDnQ-wMHdt6cyvVMQQPAh7PQWSuM5eAGiE6YTNgErga8G0c5NYk10-9b3_2bUmtH--cJnM9P0wo0OAgyLnm9DKEVqzxZU Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Domain-Id: None Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Domain-Name: None Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Identity-Status: Confirmed Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Is-Admin-Project: True Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Openstack-Nova-Api-Version: 2.92 Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Domain-Id: default Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Domain-Name: Default Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Project-Name: admin Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Role: reader,admin,member Oct 23 02:05:15.414934 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Roles: reader,admin,member Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ab10d627c6844be3824524caf5053de2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ab10d627c6844be3824524caf5053de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ab10d627c6844be3824524caf5053de2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant: admin Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant-Id: ab10d627c6844be3824524caf5053de2 Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-Tenant-Name: admin Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User: admin Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Domain-Id: default Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Domain-Name: Default Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Id: ef10648b88704f08acf4b18d8fe4cfac Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: X-User-Name: admin Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: method: > Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: exception: Flavor 451 could not be found. Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: action_args: {'id': '451'} Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:05:15.416466 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:15.417306 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: ERROR nova.api.openstack.wsgi Oct 23 02:05:15.418360 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-40025188-7bde-4483-8a98-d3fc8e23169d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:05:15.419980 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-40025188-7bde-4483-8a98-d3fc8e23169d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011266 Oct 23 02:05:15.419980 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 23 02:05:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 23 02:05:16.633050 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:16.634068 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 23 02:05:16.634495 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:17.160940 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-ffbbaafa-31ec-4220-86c0-a30d7abfddc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:05:17.181199 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-ffbbaafa-31ec-4220-86c0-a30d7abfddc6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.407573 Oct 23 02:05:17.181747 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Oct 23 02:05:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:05:18.405803 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:18.406844 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 23 02:05:18.407236 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:05:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:18.936777 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-8efcf3ab-fa1b-452b-94c5-9e6d368dea7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:05:18.956302 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-8efcf3ab-fa1b-452b-94c5-9e6d368dea7d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408855 Oct 23 02:05:18.956845 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Oct 23 02:05:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:05:20.167484 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:20.168493 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 23 02:05:20.169145 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:20.693448 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-bc0a1f32-d7c6-40a2-8758-477b6c8cd2b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:05:20.713049 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-bc0a1f32-d7c6-40a2-8758-477b6c8cd2b7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406121 Oct 23 02:05:20.713621 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Oct 23 02:05:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:05:21.919396 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:21.920402 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 23 02:05:21.920789 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:22.446929 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-02ec87e2-567a-4b57-88fc-60cc7fa23966 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:05:22.466635 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-02ec87e2-567a-4b57-88fc-60cc7fa23966 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.406822 Oct 23 02:05:22.467184 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Sun Oct 23 02:05:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 02:05:23.684667 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:23.685536 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Oct 23 02:05:23.685936 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:05:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:05:24.206311 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-ff9f407f-c1ae-419f-9126-25f786dfa347 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:05:24.226405 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-ff9f407f-c1ae-419f-9126-25f786dfa347 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404508 Oct 23 02:05:24.226990 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Sun Oct 23 02:05:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:06:20.974314 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:20.976026 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-cfd634fd-027b-4b67-9336-d3ea6772fd81 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 Oct 23 02:06:20.976425 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Sun Oct 23 02:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:06:20.986768 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:21.362276 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-323092bc-97e8-4634-a09c-b0cc18fb1a5b admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:21.383520 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-323092bc-97e8-4634-a09c-b0cc18fb1a5b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401001 Oct 23 02:06:21.384217 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Sun Oct 23 02:06:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:06:21.406681 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writing DB stats nova_api:SELECT=14 {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:06:21.410324 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-ba183e36-8ef4-48be-a201-bcfd37165d48 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:21.417990 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-ba183e36-8ef4-48be-a201-bcfd37165d48 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012742 Oct 23 02:06:21.418512 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Sun Oct 23 02:06:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:21.430463 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-32e7a77b-6d26-4d10-aeb8-639496336392 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:21.437615 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-32e7a77b-6d26-4d10-aeb8-639496336392 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011358 Oct 23 02:06:21.438123 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Sun Oct 23 02:06:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:06:21.450115 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:21.457237 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010833 Oct 23 02:06:21.457745 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Sun Oct 23 02:06:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:06:21.468800 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-d91b79ef-7557-4b79-8364-76902436ccfd admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:06:21.475848 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-d91b79ef-7557-4b79-8364-76902436ccfd admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010410 Oct 23 02:06:21.476353 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Sun Oct 23 02:06:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:09:15.796262 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:15.797268 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 23 02:09:15.797661 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:15.941234 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_api:SELECT=6 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:16.104303 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-7d1a7a60-70e6-4638-9292-e08405bce661 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:16.108971 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-7d1a7a60-70e6-4638-9292-e08405bce661 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:16.109461 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-7d1a7a60-70e6-4638-9292-e08405bce661 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:16.109879 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-7d1a7a60-70e6-4638-9292-e08405bce661 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:16.110610 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-7d1a7a60-70e6-4638-9292-e08405bce661 admin admin] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:16.111051 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-7d1a7a60-70e6-4638-9292-e08405bce661 admin admin] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:16.111457 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-7d1a7a60-70e6-4638-9292-e08405bce661 admin admin] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:16.142982 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-7d1a7a60-70e6-4638-9292-e08405bce661 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.202864 Oct 23 02:09:16.143539 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 23 02:09:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:09:17.212287 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:17.213333 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Oct 23 02:09:17.213758 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:17.405209 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-e5ec42e3-ad2d-4945-b539-c1e1d87fead9 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:17.408681 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-e5ec42e3-ad2d-4945-b539-c1e1d87fead9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:17.409186 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-e5ec42e3-ad2d-4945-b539-c1e1d87fead9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:17.409633 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-e5ec42e3-ad2d-4945-b539-c1e1d87fead9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:17.410329 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-e5ec42e3-ad2d-4945-b539-c1e1d87fead9 admin admin] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:17.410800 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-e5ec42e3-ad2d-4945-b539-c1e1d87fead9 admin admin] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:17.411212 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-e5ec42e3-ad2d-4945-b539-c1e1d87fead9 admin admin] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:17.431676 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-e5ec42e3-ad2d-4945-b539-c1e1d87fead9 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076635 Oct 23 02:09:17.432217 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 23 02:09:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:09:28.937847 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:28.938814 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 23 02:09:28.939246 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:29.084758 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_cell0:SELECT=4 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:29.085476 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_cell1:SELECT=4 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:29.086075 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG dbcounter [-] [103888] Writing DB stats nova_api:SELECT=8 {{(pid=103888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:09:29.133536 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-414f614f-8d3f-4004-8ef0-f05d649edee6 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:29.137032 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-414f614f-8d3f-4004-8ef0-f05d649edee6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:29.137512 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-414f614f-8d3f-4004-8ef0-f05d649edee6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:29.137936 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-414f614f-8d3f-4004-8ef0-f05d649edee6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:29.138673 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-414f614f-8d3f-4004-8ef0-f05d649edee6 admin admin] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:29.139119 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-414f614f-8d3f-4004-8ef0-f05d649edee6 admin admin] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:29.139533 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-414f614f-8d3f-4004-8ef0-f05d649edee6 admin admin] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:29.164671 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-414f614f-8d3f-4004-8ef0-f05d649edee6 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085518 Oct 23 02:09:29.165223 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 23 02:09:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:09:30.227604 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG nova.api.openstack.wsgi [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] Calling method '>' {{(pid=103889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:30.228680 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: INFO nova.api.openstack.requestlog [None req-a3d03ba7-bcdf-4f46-9738-593fdf3debb2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 23 02:09:30.229074 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: [pid: 103889|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Sun Oct 23 02:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:09:30.421689 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG nova.api.openstack.wsgi [None req-1f3e3456-4bc8-405c-b34b-30c3b6c5d832 admin admin] Calling method '>' {{(pid=103888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:09:30.425075 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-1f3e3456-4bc8-405c-b34b-30c3b6c5d832 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:30.425584 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-1f3e3456-4bc8-405c-b34b-30c3b6c5d832 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:30.426122 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-1f3e3456-4bc8-405c-b34b-30c3b6c5d832 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:30.426969 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-1f3e3456-4bc8-405c-b34b-30c3b6c5d832 admin admin] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:09:30.427418 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-1f3e3456-4bc8-405c-b34b-30c3b6c5d832 admin admin] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:09:30.427834 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: DEBUG oslo_concurrency.lockutils [None req-1f3e3456-4bc8-405c-b34b-30c3b6c5d832 admin admin] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:09:30.450232 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: INFO nova.api.openstack.requestlog [None req-1f3e3456-4bc8-405c-b34b-30c3b6c5d832 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079459 Oct 23 02:09:30.450806 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: [pid: 103888|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Sun Oct 23 02:09:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:10:28.323651 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: Sun Oct 23 02:10:28 2022 - graceful shutdown triggered... Oct 23 02:10:28.324155 dv-cinder-861491-5-iscsi devstack@n-api.service[103888]: Gracefully killing worker 1 (pid: 103888)... Oct 23 02:10:28.323775 dv-cinder-861491-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 23 02:10:28.324921 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: Gracefully killing worker 2 (pid: 103889)... Oct 23 02:10:28.450080 dv-cinder-861491-5-iscsi devstack@n-api.service[103889]: DEBUG dbcounter [-] [103889] Writing DB stats nova_api:SELECT=4 {{(pid=103889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:10:29.324796 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: worker 1 buried after 1 seconds Oct 23 02:10:29.325333 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: worker 2 buried after 1 seconds Oct 23 02:10:29.325333 dv-cinder-861491-5-iscsi devstack@n-api.service[103887]: goodbye to uWSGI. Oct 23 02:10:29.326383 dv-cinder-861491-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 23 02:10:29.326958 dv-cinder-861491-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 23 02:10:29.329769 dv-cinder-861491-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 23 02:10:29.339348 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 02:10:29 2022] *** Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: nodename: dv-cinder-861491-5-iscsi Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: machine: x86_64 Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: clock source: unix Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: pcre jit disabled Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: detected number of CPU cores: 4 Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: current working directory: / Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: detected binary path: /usr/bin/uwsgi-core Oct 23 02:10:29.341359 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: your processes number limit is 47680 Oct 23 02:10:29.342201 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: your memory page size is 4096 bytes Oct 23 02:10:29.342201 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: detected max file descriptor number: 2048 Oct 23 02:10:29.342201 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: lock engine: pthread robust mutexes Oct 23 02:10:29.342201 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: thunder lock: enabled Oct 23 02:10:29.342201 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 23 02:10:29.342201 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 02:10:29.382228 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: Python main interpreter initialized at 0x5576a9ce49c0 Oct 23 02:10:29.382228 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: python threads support enabled Oct 23 02:10:29.382228 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: your server socket listen backlog is limited to 100 connections Oct 23 02:10:29.382228 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: your mercy for graceful operations on workers is 90 seconds Oct 23 02:10:29.382716 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 02:10:29.382716 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: *** Operational MODE: preforking *** Oct 23 02:10:29.383100 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: *** uWSGI is running in multiple interpreter mode *** Oct 23 02:10:29.383100 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: spawned uWSGI master process (pid: 118859) Oct 23 02:10:29.383190 dv-cinder-861491-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 23 02:10:29.384866 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: spawned uWSGI worker 1 (pid: 118877, cores: 1) Oct 23 02:10:29.384866 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: spawned uWSGI worker 2 (pid: 118878, cores: 1) Oct 23 02:10:29.384866 dv-cinder-861491-5-iscsi devstack@n-api.service[118859]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 02:10:30.051082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 02:10:30.059724 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 23 02:10:31.304209 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 02:10:31.304209 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: from cryptography.utils import int_from_bytes Oct 23 02:10:31.304878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 02:10:31.304878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: from cryptography.utils import int_from_bytes Oct 23 02:10:31.307591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 02:10:31.307591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: from cryptography.utils import int_from_bytes Oct 23 02:10:31.308030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 02:10:31.308030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: from cryptography.utils import int_from_bytes Oct 23 02:10:33.748734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 02:10:33.749710 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 02:10:33.750526 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 02:10:33.750910 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 02:10:33.751173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 02:10:33.751570 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.751904 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.752232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.752556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.752893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.753352 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.753979 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 02:10:33.754348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.754460 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 02:10:33.754557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.754858 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.754973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 02:10:33.755135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.755282 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 02:10:33.755439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.755540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 02:10:33.755771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-5-iscsi {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.755877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.756103 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.756216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.756418 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.756531 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.756739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.756840 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.757060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.757231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.757386 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.757530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.757692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.757851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.758009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.758159 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.758363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.758559 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.758735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.758963 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.759296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-5-iscsi {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.759783 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.760026 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.760259 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.760480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.760715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.760924 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.761135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.761354 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.761572 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.761790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.762016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.762225 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.762475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.762726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.762973 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.762973 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.763406 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.763406 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.763808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.764016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.764226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.764547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.764773 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-5-iscsi {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.764982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.765171 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.765401 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.765608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.765756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.765900 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.766084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.766234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.766384 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.766569 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.766752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.766931 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.767257 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-5-iscsi {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.767418 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.767573 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.767740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.767893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.770781 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.770983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.771152 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.771317 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.771474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.771621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.771766 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.771912 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.772072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.772219 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.772376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.772541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.772687 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.772837 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.772992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.773145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.773300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.773451 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.773607 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.773760 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.773984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.774140 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.774312 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.774312 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.774741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.774894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.775048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.775194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.775344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.775495 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.775651 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.775811 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.775967 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.776119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.776272 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.776433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.776578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.776748 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.776902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.777058 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.777302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.777465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.777638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.777902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.778160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.778331 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.778516 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.778681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.778839 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.778997 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.779148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.779301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.779445 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.779644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.779795 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.779957 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.780110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.780254 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.780404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.780606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.780764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.780915 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.781058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.781201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.781352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.781352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.781679 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.781679 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.781957 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.782107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.782258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.782421 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.782601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.782801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.782957 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.783102 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.783253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.783405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.783556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.783699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.783848 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.784000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.784153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.784304 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.784492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.784664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.784810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.785905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.786084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.786245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.786402 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.786615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.786773 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.786919 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.787077 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.787231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.787469 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.787641 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.787786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.788050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.788211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.788356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.788505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.788662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.788806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.788965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.789119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.789264 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.789407 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.789562 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.789718 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.789878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.790037 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.790181 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.790324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.790489 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.790670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.790828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.790981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.791132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.792624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.792794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.792794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.793110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.793265 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.793410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.793561 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.793705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.793859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.794010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.794154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.794296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.794468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.794631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.794790 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.794937 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.795100 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.795253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.795398 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.795548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.795691 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.795835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.795986 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.796144 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.796288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.796431 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.796574 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.796716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.796867 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.797031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.797175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.797319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.797482 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.797718 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.797878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.798051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.798296 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.798495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.798666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.798819 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.798971 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.799125 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.799269 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.799425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.799425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.799706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.799865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.800023 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.800793 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.801041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.801341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.801508 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.801666 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.801811 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.801967 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.802126 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.802281 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.802425 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.802604 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.802748 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.802891 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.803047 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.803192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.803344 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.803495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.803639 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.803792 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.803792 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.804091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.804242 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.804387 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.804529 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.804682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.804825 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.804967 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.805119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.805262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.805413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.805875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.806032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.806188 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.806339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.806524 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.806683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.806838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.806982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.807125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.807278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.807422 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.807574 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 02:10:33.807737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.807958 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.808119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.808281 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.808525 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.808686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.808840 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.808991 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.809143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.809299 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.809446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.809606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.809752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.809895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.810039 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.810199 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.810356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.810528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.810678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.810821 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.810974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.811133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.811292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.811436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.811593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.811744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.811897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.812051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.812210 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.812368 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.812522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.812665 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.812815 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.812967 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.813110 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.813261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.813405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.813563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.813721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.813866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.814021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.814174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.814318 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.814488 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.814640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.814795 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.814948 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.815203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.815356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.815508 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.815660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.816436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.816609 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.816766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.816920 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.817065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.817217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.817360 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.817512 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.817664 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.817816 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.817980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.818204 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.818353 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.818690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.818860 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.819013 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.819165 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.819320 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.819465 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.819624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.819769 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.819913 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.820064 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.820223 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.820376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.820536 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.820691 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.820846 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.820990 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.821143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.821295 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.821448 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.821592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.821737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.821893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.822037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.822190 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.822334 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.822769 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.822930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.823086 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.823232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.823385 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.823538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.823694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.823853 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.824003 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.824164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.824325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.824476 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.824633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.824785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.824935 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.825107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.825294 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.825449 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.825599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.825758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.825929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.826394 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.826611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.826773 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.826924 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.827083 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.827235 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.827419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.827752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.827919 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.828082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.828324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.828491 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.828684 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.828924 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.829089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.829252 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.829412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.829578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.829730 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.829880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.830047 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.830199 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.830349 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.830542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.830715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.830874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.831031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.831187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.831389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.831559 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.831721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.831880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.832042 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.832200 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.832358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.832358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.832666 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.832666 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.832961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.833113 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.833273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.833273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.833568 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.833568 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.833862 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.834033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.834258 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.834420 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.834609 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.834769 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.834928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.835079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.835240 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.835392 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.835550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.835701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.835853 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.836022 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.836183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.836183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.836469 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.836618 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.836774 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.836941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.837094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.837245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.837395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.837552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.837703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.837870 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.838033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.838183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.838359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.838558 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.838712 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.838880 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.839147 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.839305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.839468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.839621 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.839770 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.839930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.840089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.840251 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.840400 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.840560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.840722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.840875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.841027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.841185 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.841336 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.841493 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.841658 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.841817 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.841968 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.842125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.842125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.842423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.842633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.842786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.842936 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.843093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.843252 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.843403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.843564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.843721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.843871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.844021 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.844180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.844356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.844508 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.844672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.844824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.844975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.845132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.845297 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.845450 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.845606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.845758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.845915 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.846067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.846230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.847094 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.847275 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.847438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.847749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.848022 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.848180 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.848339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.848506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.848660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.848810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.848961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.849149 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.849396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.849576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.849742 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.849894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.850044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.850201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.850358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.850552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.850740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.851173 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.851345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.851518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.851680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.851838 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.851997 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.852167 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.852490 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.852658 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.852824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.852975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.853126 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.853276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.853434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.853584 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.853756 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.853907 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.854057 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.854207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.854364 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.854590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.854760 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.854911 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.855070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.855221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.855371 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.855529 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.855693 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.855865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.856017 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.856174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.856332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.856491 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.856658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.856816 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.856966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.857123 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.857281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.857439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.857590 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.857740 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.857900 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.858057 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.858217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.858376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.858553 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.858705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.858856 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.859016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.859174 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.859333 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.859599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.859765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.859928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.860097 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.860257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.860415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.860567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.860728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.860886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.861037 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.861418 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.861562 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.861700 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.861851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.861851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.862146 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.862301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.862471 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.863253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.863414 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.863781 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.864214 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.864335 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.864522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.864685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.864867 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.865007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.865195 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.865387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.865539 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.865703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.865859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.866003 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.866225 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.866369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.866530 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.866668 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.866808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.866959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.867114 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.867255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.867408 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.867548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.867695 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.867835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.867984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.868125 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.868265 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.868418 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.868559 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.868706 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.868847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.868998 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.869136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.869295 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.869457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.869632 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.869884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.870025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.870177 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.870317 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.870500 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.870652 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.870794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.870955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.871106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.871248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.871410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.871561 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.871710 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.871858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.872005 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.872146 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.872294 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.872435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.872586 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.872726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.872868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.873008 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.873173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.873315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.873315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.873579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.873726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.873866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874294 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874760 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.874929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.875359 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.875502 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.875642 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.875790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.875931 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.876071 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.876219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.876359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.876500 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.876661 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.876806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.876955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.877106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.877106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.877380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.877534 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.877677 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.877824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.877964 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.878104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.878418 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.879234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.879425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.879640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.879786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.879929 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880346 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880808 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.880985 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881078 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881177 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881263 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881452 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881630 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881725 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881904 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.881995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882256 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882434 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882540 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.882990 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883268 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883361 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883762 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883857 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.883951 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884213 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884590 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884760 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.884983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885169 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885432 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885519 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885604 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.885959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886493 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886857 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.886941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887616 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887730 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887841 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.887841 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888291 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888638 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888750 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888870 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.888983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.889102 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.889221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.889340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.889452 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.889452 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.889749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.889869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.889988 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890099 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890216 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890608 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890831 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890949 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.890949 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.891326 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.891477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.891598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.891598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.891823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.891936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.892066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.892188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.892331 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.892464 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.892608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.892741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.892878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.892977 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893078 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893514 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.893913 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894015 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894411 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894551 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894641 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894641 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894804 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.894973 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895070 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895708 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.895933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896026 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896280 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896391 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896615 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.896963 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897196 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897276 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897667 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.897933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.898306 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.898394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.898497 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.898584 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.898678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.898771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.898771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.898955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899293 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899385 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899471 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899639 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899730 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.899917 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900004 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900087 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900352 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900810 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.900987 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901435 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901529 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901697 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901790 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.901961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.902045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.902129 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.902377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.902584 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.902699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.902819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.902951 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.903071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.903250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.903354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.903564 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.903666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.903874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.903967 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.904231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.904386 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.904492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.904588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.904796 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.904892 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.905109 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.905210 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.905416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.905509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.905730 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.906039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.906144 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.906453 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.906760 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.906855 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.907072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.907173 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.907391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.907485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.907702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.907795 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.908020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.908171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.908337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.908429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.908646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.908738 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.908965 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.909068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.909274 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.909368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.909729 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.909826 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.910049 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.910151 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.910359 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.910516 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.910701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.910802 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.911013 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.911107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.911322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.911416 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.911636 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.911739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.911945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.912048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.912256 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.912399 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.912588 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.912726 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.912865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.912996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.913192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.913290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.913501 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.913608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.913825 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.913920 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.914211 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.914302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.914580 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.914696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.914894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.915002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.915256 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.915363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.915585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.915790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.915893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.915982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.916228 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.916370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.916537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.916632 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.916856 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.916949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.917169 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.917274 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.917488 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.917581 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.917804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.917899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.918116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.918221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.918434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.918542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.918764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.918859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.919083 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.919188 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.919394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.919489 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.919713 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.919807 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.920040 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.920134 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.920362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.920462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.920690 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.920785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.921066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.921159 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.921389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.921482 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.921719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.921812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.922032 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.922127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.922339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.922474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.922697 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.922856 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.922981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.923120 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.923292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.923644 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.923644 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.923827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.923927 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.924021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.924209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.924303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.924519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.924621 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.924828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.924921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.925660 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.925831 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.925973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.926078 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.926284 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.926377 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.926620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.926729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.926949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.927052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.927262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.927357 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.927588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.927688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.927907 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.928009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.928215 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.928309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.928540 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.928635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.928848 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.928942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.929155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.929249 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.929462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.929555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.929769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.929871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.930079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.930189 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.930388 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.930747 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.931000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.931096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.931316 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.931417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.931642 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.931744 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.931976 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.932122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.932313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.932418 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.932631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.932750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.933006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.933116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.933283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.933387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.933607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.933749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.933918 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.934051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.934237 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.934345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.934592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.934690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.934904 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.935006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.935211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.935314 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.935518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.935620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.935824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.935925 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.936134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.936240 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.936442 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.936539 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.936755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.936858 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.937063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.937157 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.937375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.937470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.937680 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.937782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.938007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.938114 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.938314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.938419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.938645 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.938756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.938954 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.939062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.939260 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.939363 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.939569 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.939664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.939876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.939979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.940224 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.940319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.940533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.940671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.940900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.941053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.941222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.941324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.941552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.941691 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.941881 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.941979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.942260 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.942464 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.942603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.942707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.943062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.943174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.943313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.943436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.943535 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.943715 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.943849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.944041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.944188 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.944369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.944525 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.944790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.945074 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.945253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.945397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.945551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.945765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.946056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.946219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.946371 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.946588 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.946717 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.946812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.947035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.947176 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.947352 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.947475 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.947667 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.947784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.948020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.948190 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.948362 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.948546 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.948651 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.948868 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.948972 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.949190 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.949296 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.949510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.949608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.949846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.949951 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.950163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.950264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.950515 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.950628 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.950835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.950945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.951171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.951276 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.951493 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.951611 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.951803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.951893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.952119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.952226 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.952439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.952553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.952755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.952868 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.953072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.953206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.953386 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.953516 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.953756 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.953866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.954008 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.954101 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.954325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.954562 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.954659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.954744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.954958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.955051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.955272 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.955366 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.955586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.955683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.955904 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.956014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.956221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.956313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.956570 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.956754 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.956907 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.957063 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.957230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.957380 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.957557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.957850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.957992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.958155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.958298 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.958512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.958651 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.958845 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.959041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.959175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.959362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.959495 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.959704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.959807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.960036 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.960131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.960365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.960459 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.960692 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.960794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.961014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.961117 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.961322 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.961416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.961631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.961743 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.961940 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.962042 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.962253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.962352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.962775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.962880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.962880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.963041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.963222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.963372 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.963485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.963728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.963832 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.964056 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.964780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.964890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.964987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965669 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965892 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.965988 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.966223 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.966330 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.966566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.966665 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.966879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.966973 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.967191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.967286 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.967503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.967607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.967810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.967913 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.968122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.968224 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.968434 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.968535 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.968738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.968843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.969043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.969136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.969348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.969449 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.969659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.969759 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.969966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.970074 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.970274 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.970378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.970605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.970699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.970918 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.971029 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.971226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.971336 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.971532 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.971624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.971839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.972560 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.972698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.972940 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.973076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.973277 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.973411 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.973574 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.973699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.973884 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.974003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.974189 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.974316 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.974520 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.974631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.974836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.974937 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.975144 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.975246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.975459 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.975554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.975788 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.975888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.976095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.976211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.976402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.976498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.976722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.976844 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.977029 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.977136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.977339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.977434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.977652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.977745 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.977965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.978059 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.978290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.978387 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.978689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.978801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.978952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.979210 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.979313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.979548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.979643 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.979871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.980132 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.980242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.980470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.980579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.980797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.980892 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.981119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.981221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.981428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.981531 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.981747 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.981849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.982056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.982158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.982366 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.982522 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.982705 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.982811 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.983019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.983113 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.983328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.983464 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.983639 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.983784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.983939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.984038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.984244 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.984338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.984554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.984657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.984864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.984957 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.985178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.985281 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.985694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.985802 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.985891 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.985985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.986075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.986162 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.986378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.986495 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.986717 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.986830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.987030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.987143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.987349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.987443 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.987735 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.987916 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.988068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.988201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.988351 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.988455 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.988663 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.988773 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.988976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.989099 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.989286 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.989381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.989602 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.989696 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.989914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.990017 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.990228 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.990331 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.990556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.990670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.990901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.990997 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.991222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.991324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.991532 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.991638 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.991891 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.992030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.992207 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.992334 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.992534 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.992652 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.992862 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.992966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.993172 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.993298 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.993512 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.993615 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.993808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.993932 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.994121 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.994221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.994465 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.994593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.994781 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.994875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.995115 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.995222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.995431 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.995545 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.995736 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.995852 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.996043 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.996153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.996357 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.996463 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.996675 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.996775 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.996980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.997071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.997287 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.997385 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.997592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.997684 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.997904 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.997995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.998209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.998308 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.998547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.998643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.998908 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.999021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.999172 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.999263 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.999518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.999697 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.999794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:33.999894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.000116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.000256 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.000415 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.000590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.000695 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.000899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.000996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.001207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.001345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.001518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.001640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.001865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.001967 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.002168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.002297 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.002493 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.002593 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.002806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.002913 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.003109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.004054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.004054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.004265 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.004364 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.004631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.004734 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.004862 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.004955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.005053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.005142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.005306 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.005453 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.005640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.005772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.005952 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.006098 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.006279 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.006413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.006621 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.006765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.006936 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.007077 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.007250 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.007402 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.007585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.007729 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.007897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.008048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.008212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.008365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.008524 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.008702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.008835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.009016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.009139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.009333 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.009441 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.009647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.009743 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.009959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.010076 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.010270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.010378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.010607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.010741 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.010973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.011106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.011306 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.011415 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.011618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.011720 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.011947 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.012040 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.012265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.012369 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.012578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.012681 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.012891 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.012986 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.013202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.013296 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.013510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.013603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.013824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.013997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.014288 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.014381 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.014491 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.014596 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.014885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.014979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.015075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.015183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.015361 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.015456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.015675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.015779 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.015987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.016091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.016307 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.016413 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.016623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.016733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.016951 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.017051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.017277 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.017370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.017591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.017699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.017919 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.018022 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.018254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.018349 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.018594 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.018707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.019001 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.019169 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.019370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.019498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.019625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 02:10:34.019793 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.020120 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.020435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.020745 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 02:10:34.020997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 02:10:34.083134 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO dbcounter [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Registered counter for database nova_api Oct 23 02:10:34.084141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO dbcounter [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Registered counter for database nova_api Oct 23 02:10:34.103784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:10:34.105359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_db.sqlalchemy.engines [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:10:34.110729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writer thread running {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:10:34.112044 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writer thread running {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:10:34.168648 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.context [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9a91453-b148-423b-846a-e9f010e30c38(cell1) {{(pid=118878) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 02:10:34.170304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.context [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b9a91453-b148-423b-846a-e9f010e30c38(cell1) {{(pid=118877) load_cells /opt/stack/nova/nova/context.py:464}} Oct 23 02:10:34.172718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:34.173194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:34.174328 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:34.174789 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:34.174900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:34.176162 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:34.176615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:34.177152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:34.177877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:10:34.178333 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:10:34.178633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:34.180364 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:10:34.180912 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO dbcounter [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Registered counter for database nova_cell0 Oct 23 02:10:34.182672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO dbcounter [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Registered counter for database nova_cell0 Oct 23 02:10:34.185031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO dbcounter [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Registered counter for database nova_cell1 Oct 23 02:10:34.186999 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO dbcounter [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Registered counter for database nova_cell1 Oct 23 02:10:34.192770 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:10:34.194691 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_db.sqlalchemy.engines [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:10:34.196872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_db.sqlalchemy.engines [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:10:34.197675 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:10:34.202688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writer thread running {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:10:34.203680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writer thread running {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:10:34.204991 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writer thread running {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:10:34.207702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writer thread running {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:10:34.354536 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO dbcounter [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Registered counter for database nova_cell0 Oct 23 02:10:34.357473 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO dbcounter [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Registered counter for database nova_cell0 Oct 23 02:10:34.361296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_db.sqlalchemy.engines [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:10:34.365478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_db.sqlalchemy.engines [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 02:10:34.370249 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writer thread running {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:10:34.370342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writer thread running {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 02:10:34.688192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: WARNING keystonemiddleware.auth_token [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 02:10:34.696096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: WARNING keystonemiddleware.auth_token [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 02:10:34.696510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: WARNING keystonemiddleware.auth_token [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 02:10:34.703732 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: WARNING keystonemiddleware.auth_token [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 02:10:35.044337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: WARNING keystonemiddleware.auth_token [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 02:10:35.050506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: WARNING keystonemiddleware.auth_token [None req-dd330d65-17fb-402c-b2bd-8b047dae07a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 02:10:35.056236 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576a9ce49c0 pid: 118877 (default app) Oct 23 02:10:35.059107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: WARNING keystonemiddleware.auth_token [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 23 02:10:35.065007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: WARNING keystonemiddleware.auth_token [None req-f7c5339b-e69c-4486-9fe9-53479ddb3f66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 23 02:10:35.071598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576a9ce49c0 pid: 118878 (default app) Oct 23 02:11:12.191897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=3 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:12.194671 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=3 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:12.196220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=3 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:12.199396 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=3 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:13.886748 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5eef8bf4-5415-4197-a96b-48a9f895f518 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Action: 'create', calling method: .version_select at 0x7f9da3f3c940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-428466812", "metadata": {"Type": "work"}}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:15.371323 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5eef8bf4-5415-4197-a96b-48a9f895f518 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.202342 Oct 23 02:11:15.372301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 23 02:11:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3205 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 23 02:11:15.844290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-57f87892-7a7b-4361-a7b5-a147f04b1579 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Calling method '.version_select at 0x7f9da3f6ba60>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:15.898644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:15.899412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:15.900626 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:15.907093 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:16.422625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-57f87892-7a7b-4361-a7b5-a147f04b1579 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f" status: 200 len: 352 microversion: 2.1 time: 1.038060 Oct 23 02:11:16.430108 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 1/2] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:11:15 2022] GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f => generated 352 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:17.440260 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f618904c-f931-4755-959c-b81bc6180562 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Calling method '.version_select at 0x7f9da3d8de50>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:17.723462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f618904c-f931-4755-959c-b81bc6180562 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f" status: 200 len: 353 microversion: 2.1 time: 0.289963 Oct 23 02:11:17.724035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:11:17 2022] GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f => generated 353 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:17.738623 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e17c4801-bbed-4ec3-b824-e3e50229e0ea tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Calling method '.version_select at 0x7f9da3dbcd30>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:17.996182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e17c4801-bbed-4ec3-b824-e3e50229e0ea tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f" status: 200 len: 353 microversion: 2.1 time: 0.261820 Oct 23 02:11:17.996755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:11:17 2022] GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f => generated 353 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:18.015974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7bdd2948-fe09-438f-8cbe-dca748d01938 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Calling method '.version_select at 0x7f9da3d22550>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:18.303586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7bdd2948-fe09-438f-8cbe-dca748d01938 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f" status: 202 len: 0 microversion: 2.1 time: 0.291542 Oct 23 02:11:18.304194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:11:18 2022] DELETE /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:11:18.313085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bc2c0748-c582-44f0-92ef-a2055c688d23 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Calling method '.version_select at 0x7f9da3dbcca0>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:18.402019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bc2c0748-c582-44f0-92ef-a2055c688d23 tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f" status: 200 len: 352 microversion: 2.1 time: 0.093516 Oct 23 02:11:18.409569 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:11:18 2022] GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:19.417768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e20d7947-83df-4d9f-8662-add513b8401b tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Calling method '.version_select at 0x7f9da3d22c10>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:19.494616 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-e20d7947-83df-4d9f-8662-add513b8401b tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] HTTP exception thrown: Volume acbc8d74-8b88-426a-937a-f12dcbad8e6f could not be found. Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e20d7947-83df-4d9f-8662-add513b8401b tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Request method failure captured: Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f HTTP/1.1 Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLAS04T5PQFRtFeaQvUhG5jUpw0ALivR-Nnb4lfG_xE8sKLGRoy06D4FErgZivp8m-xUI4AWnxGGoRrN-lhiADDZB-PUlTaW81eX42WRNm1irx1S70q87BgyGpW7YWQ2Ege1vc9AqMb2NmjPT3M9l99H4tQ_gI_0GH2CtnbpmWy5B0 Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: f7620aafbe254b9aa92329275c1b6738 Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesGetTestJSON-1785491239 Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:11:19.499722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7620aafbe254b9aa92329275c1b6738"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/f7620aafbe254b9aa92329275c1b6738"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_f7620aafbe254b9aa92329275c1b6738"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/f7620aafbe254b9aa92329275c1b6738"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesGetTestJSON-1785491239 Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: f7620aafbe254b9aa92329275c1b6738 Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesGetTestJSON-1785491239 Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesGetTestJSON-1785491239-project Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 284489374b204776af052704ac522bcf Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesGetTestJSON-1785491239-project Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Volume acbc8d74-8b88-426a-937a-f12dcbad8e6f could not be found. Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'acbc8d74-8b88-426a-937a-f12dcbad8e6f'} Oct 23 02:11:19.501202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume acbc8d74-8b88-426a-937a-f12dcbad8e6f could not be found. (HTTP 404) (Request-ID: req-d0f083d2-d41e-47c6-97a2-bb675ea1a2e2) Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:11:19.502104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:11:19.503413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume acbc8d74-8b88-426a-937a-f12dcbad8e6f could not be found. Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 02:11:19.504673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume acbc8d74-8b88-426a-937a-f12dcbad8e6f could not be found. Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume acbc8d74-8b88-426a-937a-f12dcbad8e6f could not be found. Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e20d7947-83df-4d9f-8662-add513b8401b tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] Returning 404 to user: Volume acbc8d74-8b88-426a-937a-f12dcbad8e6f could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:11:19.505812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e20d7947-83df-4d9f-8662-add513b8401b tempest-VolumesGetTestJSON-1785491239 tempest-VolumesGetTestJSON-1785491239-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f" status: 404 len: 109 microversion: 2.1 time: 0.088051 Oct 23 02:11:19.510041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:11:19 2022] GET /compute/v2.1/os-volumes/acbc8d74-8b88-426a-937a-f12dcbad8e6f => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:11:21.442777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f7660216-b71b-40c2-8e59-0549024ecca4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'create', calling method: .version_select at 0x7f9da3d7f430>, body: {"keypair": {"name": "tempest-keypair-2122928426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsq0NHMgHCgwBKYpDchFo1ZNKULOYtsItLMtDg21ezYlSb8ADcKA2+6UUYUXjpNDOY8T6rMVbkdlDxQQAVJ1QGsrVGAuVhFAdRG8bNQfsm7OcYQkKqoawXwPrSw+3wrhA=="}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:21.567368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-f7660216-b71b-40c2-8e59-0549024ecca4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Getting quotas for project fa4d62bf272e4ce69022518ff362813f. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:11:21.575603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-f7660216-b71b-40c2-8e59-0549024ecca4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Getting quotas for user c9dba6c5f7e9472faa5aa963758d78fe and project fa4d62bf272e4ce69022518ff362813f. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:11:21.659752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f7660216-b71b-40c2-8e59-0549024ecca4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.742602 Oct 23 02:11:21.663346 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 4/8] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 23 02:11:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 747 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 02:11:25.017949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-822057321", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bfefda5-1c31-4cf3-a13e-af4e5cedf457"}], "security_groups": [{"name": "tempest-securitygroup--334442926"}], "key_name": "tempest-keypair-2122928426", "user_data": "}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:25.661508 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] validate_networks() for [('7bfefda5-1c31-4cf3-a13e-af4e5cedf457', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:11:27.134818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c52fff47-57b1-49b9-a7da-97b647ea04b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'create', calling method: .version_select at 0x7f9da3cf9820>, body: {"keypair": {"name": "tempest-keypair-598909238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlSRbf7vOxG/uJPav/WyJqVkgZEfWRdEIgFZTfiQ8BsgnaF9i9uvvuAFGxZoAj33qyZU3g409kfI5EEHzwVnSLXTTj0GyxGlIogoShnRkooYRKRE1aa6N51NQUNz9YhJw=="}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:27.174605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-c52fff47-57b1-49b9-a7da-97b647ea04b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Getting quotas for project 49a39f93e67c4d3f9529bdef5bb66b4c. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:11:27.185684 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-c52fff47-57b1-49b9-a7da-97b647ea04b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Getting quotas for user 006623bab8f04f448edf0d43397192d8 and project 49a39f93e67c4d3f9529bdef5bb66b4c. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:11:27.253004 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c52fff47-57b1-49b9-a7da-97b647ea04b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.379746 Oct 23 02:11:27.262487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 5/9] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:11:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:28.763278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:11:28.764537 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:11:28.765426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:11:28.766998 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:11:28.767675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:11:28.803534 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:28.804486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:28.805241 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:28.806683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:28.807427 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:28.809943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:28.866683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Getting quotas for project fa4d62bf272e4ce69022518ff362813f. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:11:28.880919 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Getting quotas for user c9dba6c5f7e9472faa5aa963758d78fe and project fa4d62bf272e4ce69022518ff362813f. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:11:28.899088 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:11:28.904541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:11:29.080566 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-81bf5375-c5a9-4aa3-94dc-6cc389c17441 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.068856 Oct 23 02:11:29.081792 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 5/10] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 23 02:11:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 4071 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 02:11:29.093282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-87a35511-6201-4b96-971c-1479badf0306 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:29.094539 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-87a35511-6201-4b96-971c-1479badf0306 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:29.445497 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-87a35511-6201-4b96-971c-1479badf0306 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:29.479548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-87a35511-6201-4b96-971c-1479badf0306 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:29.481064 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-87a35511-6201-4b96-971c-1479badf0306 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:29.482239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-87a35511-6201-4b96-971c-1479badf0306 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1281 microversion: 2.20 time: 0.393557 Oct 23 02:11:29.485220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 6/11] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:29 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1281 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:30.516909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6c766992-33f9-4975-875e-0b9b7a9e758c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:30.517548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6c766992-33f9-4975-875e-0b9b7a9e758c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:30.739540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6c766992-33f9-4975-875e-0b9b7a9e758c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:30.795485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6c766992-33f9-4975-875e-0b9b7a9e758c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:30.797610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6c766992-33f9-4975-875e-0b9b7a9e758c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:30.803502 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6c766992-33f9-4975-875e-0b9b7a9e758c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1281 microversion: 2.20 time: 0.291180 Oct 23 02:11:30.824363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 6/12] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:30 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:31.848317 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2aec157f-d8c6-4b4b-b9df-e11e36fa6c55 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:31.848988 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2aec157f-d8c6-4b4b-b9df-e11e36fa6c55 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:32.110863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2aec157f-d8c6-4b4b-b9df-e11e36fa6c55 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:32.120189 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2aec157f-d8c6-4b4b-b9df-e11e36fa6c55 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:32.121668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2aec157f-d8c6-4b4b-b9df-e11e36fa6c55 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:32.145350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2aec157f-d8c6-4b4b-b9df-e11e36fa6c55 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1281 microversion: 2.20 time: 0.304865 Oct 23 02:11:32.170251 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 7/13] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:31 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1281 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:32.657828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2042103906", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:32.753941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] validate_networks() for [('58f026bd-fcaf-462d-9303-e2ae6bbc3a9e', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:11:33.330869 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-182447352", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "networks": [{"uuid": "c5fbd9df-9f8a-4f60-9255-3da999cfa5f9"}]}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:33.552880 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] validate_networks() for [('c5fbd9df-9f8a-4f60-9255-3da999cfa5f9', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:11:34.299913 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:11:34.300449 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:11:34.301270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:11:34.301836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:11:34.302339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:11:34.329364 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:34.332936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:34.338897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:34.340003 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:34.340665 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:34.341325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:34.411177 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Getting quotas for project d7ac3d840c9f41ea842b8f4935770f8b. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:11:34.434497 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Getting quotas for user 2335878ea1d045858b158f6b4175e896 and project d7ac3d840c9f41ea842b8f4935770f8b. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:11:34.501152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:11:34.503707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:11:34.660104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0a8b548b-9294-4ebf-98a7-32fd782b8e02 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.582268 Oct 23 02:11:34.661144 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 7/14] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:11:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:11:34.689624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1385237841", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d813ef1f-8211-49e2-a5ea-c7934e717ca1"}], "security_groups": [{"name": "tempest-securitygroup--1898319798"}], "key_name": "tempest-keypair-598909238", "user_data": "}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:35.532590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] validate_networks() for [('d813ef1f-8211-49e2-a5ea-c7934e717ca1', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:11:38.490982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:11:38.492055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:11:38.492729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:11:38.493866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:11:38.494693 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:11:38.526415 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:38.533935 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:38.534556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:38.535335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:38.535807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:38.536279 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:38.655950 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Getting quotas for project d296608fc23c4667b5173c0f3fe1697e. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:11:38.666058 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Getting quotas for user 5495217023fc44eab2fa73552db6b3f2 and project d296608fc23c4667b5173c0f3fe1697e. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:11:38.718817 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:11:38.723927 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:11:38.911464 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a9c33ab0-8a68-4a18-9af1-39aaa4d1c74f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.045022 Oct 23 02:11:38.912488 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 8/15] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:11:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 6047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:11:38.924852 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:38.925468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:38.982252 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:38.982807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:38.995633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:38.997032 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:38.997815 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:38.999905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.772306 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:11:39.772787 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:11:39.773300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:11:39.773719 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:11:39.774293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:11:39.807960 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.808511 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.809583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.818140 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.824250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.825877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.853633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:39.891838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:39.898196 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:39.904031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f83bd29e-7e87-44f5-a7d3-482097071e93 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.988816 Oct 23 02:11:39.906387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Getting quotas for project 49a39f93e67c4d3f9529bdef5bb66b4c. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:11:39.907607 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 9/16] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:38 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:39.917826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Getting quotas for user 006623bab8f04f448edf0d43397192d8 and project 49a39f93e67c4d3f9529bdef5bb66b4c. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:11:39.955018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:39.959546 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:11:39.960432 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:39.962113 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:11:39.979923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.982145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.982960 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:39.985353 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:39.987097 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:39.988715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:40.251243 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5deefd9f-d532-4904-be91-78f542367df8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.569452 Oct 23 02:11:40.254518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 8/17] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:11:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 5592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:11:40.289921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:40.291594 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-20924cce-0e26-4406-8a99-c0e3e5c97d86 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:40.292628 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-20924cce-0e26-4406-8a99-c0e3e5c97d86 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:40.300358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-51363665-6c54-4942-a7a2-f35ba9a1657c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1280 microversion: 2.1 time: 0.389667 Oct 23 02:11:40.320957 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:39 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1280 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:40.341945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f804e395-27a2-4935-925e-16647c87a26d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:40.348912 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f804e395-27a2-4935-925e-16647c87a26d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:40.522567 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-20924cce-0e26-4406-8a99-c0e3e5c97d86 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:40.537394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-20924cce-0e26-4406-8a99-c0e3e5c97d86 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1214 microversion: 2.1 time: 0.281363 Oct 23 02:11:40.551507 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 9/19] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:40 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1214 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:40.608055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f804e395-27a2-4935-925e-16647c87a26d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:40.620035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f804e395-27a2-4935-925e-16647c87a26d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1237 microversion: 2.1 time: 0.296043 Oct 23 02:11:40.620649 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 11/20] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:40 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1237 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:40.831091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-487002735", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:40.935451 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:40.937091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:40.950560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:40.963878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:40.968169 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:40.969057 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:40.971301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:40.972507 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:41.030853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] validate_networks() for [('58f026bd-fcaf-462d-9303-e2ae6bbc3a9e', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:11:41.765890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:41.780474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:41.794153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:41.819992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ed5690d7-1050-4682-8368-7da7037fccdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.889133 Oct 23 02:11:41.821734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 12/21] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:40 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:41.841384 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:41.843824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:41.863738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:41.865407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:41.873733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:41.877896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:41.880122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:41.881747 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.100000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:42.117523 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9d942360-6e51-4813-b628-b69eede91766 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1266 microversion: 2.1 time: 0.291776 Oct 23 02:11:42.121925 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 13/22] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:41 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:42.145737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:42.151242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:42.185296 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.188141 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.189577 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.192813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.195919 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.198102 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.665632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:42.690868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cc48b729-48a0-4acb-ae2d-47144f5a07c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1289 microversion: 2.1 time: 0.565817 Oct 23 02:11:42.692086 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 14/23] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:42 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1289 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:42.724627 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:11:42.725142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:11:42.725690 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:11:42.726148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:11:42.726763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:11:42.768875 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.770897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.772585 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.774888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.778100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.780382 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.854321 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:42.855076 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:42.864426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.871658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.872441 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.872715 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Getting quotas for project d7ac3d840c9f41ea842b8f4935770f8b. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:11:42.873602 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:42.877190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:42.878999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:42.891997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Getting quotas for user 2335878ea1d045858b158f6b4175e896 and project d7ac3d840c9f41ea842b8f4935770f8b. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:11:42.958786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:11:42.965885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:11:43.145995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-87a28d4c-dcd6-480f-8b98-70aab05d43d4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.319020 Oct 23 02:11:43.147209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 10/24] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:11:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:11:43.156705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:43.162896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:43.202383 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:43.205764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:43.209762 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:43.213875 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:43.217328 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:43.218020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:43.223963 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:43.253463 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:43.263261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:43.275433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-76c1dece-fb6a-480c-a3f9-7d5ad3b6fbee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.415328 Oct 23 02:11:43.287689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 15/25] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:42 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:11:43.302882 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-23c3c8b1-0582-4871-9718-ab75c3c48086 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:43.303805 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-23c3c8b1-0582-4871-9718-ab75c3c48086 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:43.641753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-23c3c8b1-0582-4871-9718-ab75c3c48086 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:43.660881 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-23c3c8b1-0582-4871-9718-ab75c3c48086 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1221 microversion: 2.1 time: 0.371713 Oct 23 02:11:43.671385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 16/26] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:43 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1221 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:43.721593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:43.727804 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:43.747030 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:43.753378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:43.755990 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:43.757020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:43.757834 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:43.759516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:43.958307 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:44.038995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b7ad5745-f836-4344-a85e-a838d7588e4b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1272 microversion: 2.1 time: 0.884670 Oct 23 02:11:44.039755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 11/27] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:43 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1272 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:44.241199 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:44.251466 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-268f6992-9f1c-4dea-baed-3db20405782f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1307 microversion: 2.1 time: 0.535300 Oct 23 02:11:44.266275 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 17/28] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:43 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1307 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:11:44.306679 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:44.307700 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:44.332198 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:44.332725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:44.338866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:44.344477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:44.345343 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:44.346572 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:44.707136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-0ed0b560-7e61-473a-8465-d63fdf028d5b req-0ae13959-7e70-4861-b7a2-280521bd357e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847628be-0620-4309-99c8-6036d43d26f7", "tag": "24fbd91b-949f-4c46-a496-148c4722eb45"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:44.744589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0ed0b560-7e61-473a-8465-d63fdf028d5b req-0ae13959-7e70-4861-b7a2-280521bd357e service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:44.746701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0ed0b560-7e61-473a-8465-d63fdf028d5b req-0ae13959-7e70-4861-b7a2-280521bd357e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:44.747226 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0ed0b560-7e61-473a-8465-d63fdf028d5b req-0ae13959-7e70-4861-b7a2-280521bd357e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:44.805259 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-0ed0b560-7e61-473a-8465-d63fdf028d5b req-0ae13959-7e70-4861-b7a2-280521bd357e service nova] Creating event network-changed:24fbd91b-949f-4c46-a496-148c4722eb45 for instance 847628be-0620-4309-99c8-6036d43d26f7 on hv-cinder-86149 Oct 23 02:11:44.806281 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0ed0b560-7e61-473a-8465-d63fdf028d5b req-0ae13959-7e70-4861-b7a2-280521bd357e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 02:11:44.808276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0ed0b560-7e61-473a-8465-d63fdf028d5b req-0ae13959-7e70-4861-b7a2-280521bd357e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 02:11:44.813550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:44.814381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:44.816765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:44.818059 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:44.821647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:44.822529 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:44.854056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.compute.rpcapi [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 23 02:11:44.856289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] Releasing lock "compute-rpcapi-router" {{(pid=118877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 02:11:44.890768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d1dd3c2d-61f1-4cdd-952f-6f41f7676182 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.629065 Oct 23 02:11:44.894826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 12/29] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:44.907968 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:44.913464 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:44.931346 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:44.934171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:44.935990 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:44.938772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:44.940780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:44.942772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:45.491404 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:45.505166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:45.514145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:45.515808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:45.516980 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e0b9bdd1-dc03-4a34-b496-7c502386aeb3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 1.215248 Oct 23 02:11:45.525640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3d31021e-7168-4663-b87d-f8db3952b3c0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1217 microversion: 2.1 time: 0.628865 Oct 23 02:11:45.529019 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 13/30] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:44 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1217 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:45.530952 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 18/31] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:44 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:45.550570 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:45.551232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:45.564575 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:45.569778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:45.570684 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:45.571045 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:45.571729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:45.572725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:45.573438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:45.574672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:45.587975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:45.588362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:45.589077 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:45.591032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:45.595804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:45.596541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.271004 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:46.288857 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e024fc81-9359-4ae5-a88f-0b6fbb1b97fb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1295 microversion: 2.1 time: 0.756631 Oct 23 02:11:46.301843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 19/32] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:45 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1295 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:46.355997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:46.365257 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5ddf25e2-d6f8-47b5-a4d9-fc6d9faa34ad tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1272 microversion: 2.1 time: 0.818908 Oct 23 02:11:46.368094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 14/33] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:45 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1272 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:46.564132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:46.564816 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:46.565552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:46.567102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:46.569503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=5 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:46.586620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.592667 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.604619 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.607494 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.608663 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.609715 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.613385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.614396 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.616161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:46.627543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:46.634095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:46.644170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:47.123894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:47.143405 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bec1a397-e268-4d72-beba-df486c5f15df tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1291 microversion: 2.1 time: 0.587602 Oct 23 02:11:47.145038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 15/34] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:46 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1291 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:47.332063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:47.333512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:47.359832 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:47.374733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:47.377629 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:47.382893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:47.389357 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:47.390084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:48.146785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:48.171398 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:48.177349 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:48.180372 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-331d9bcc-284e-4bbd-bbeb-9a792809f56f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 1.630448 Oct 23 02:11:48.198467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 20/35] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:46 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:48.216099 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:48.216805 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:48.245450 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:48.248836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:48.252516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:48.253724 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:48.254514 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:48.256817 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:48.580782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:48.800988 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:48.812534 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e1112e38-6a76-4414-b810-7841707e8ebf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1295 microversion: 2.1 time: 1.484872 Oct 23 02:11:48.828656 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 16/36] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:47 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1295 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:11:48.838125 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-c1f68474-9409-447c-81c0-812fbcb22978 req-b5584ff5-1a97-420e-8c7c-e7932ae1c361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd282d6-75f6-4241-8c5b-d364c031db43", "tag": "201fa2da-3990-492d-a724-016abaeaf38a"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:48.857619 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-c1f68474-9409-447c-81c0-812fbcb22978 req-b5584ff5-1a97-420e-8c7c-e7932ae1c361 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:48.858844 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-c1f68474-9409-447c-81c0-812fbcb22978 req-b5584ff5-1a97-420e-8c7c-e7932ae1c361 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:48.859439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-c1f68474-9409-447c-81c0-812fbcb22978 req-b5584ff5-1a97-420e-8c7c-e7932ae1c361 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:48.892039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-c1f68474-9409-447c-81c0-812fbcb22978 req-b5584ff5-1a97-420e-8c7c-e7932ae1c361 service nova] Creating event network-changed:201fa2da-3990-492d-a724-016abaeaf38a for instance afd282d6-75f6-4241-8c5b-d364c031db43 on hv-cinder-86149 Oct 23 02:11:48.905098 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-c1f68474-9409-447c-81c0-812fbcb22978 req-b5584ff5-1a97-420e-8c7c-e7932ae1c361 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072813 Oct 23 02:11:48.908853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 17/37] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:48.924033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:48.927551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:48.940719 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:48.952166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:48.954813 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:48.957362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:48.958908 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:48.961843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:49.424837 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:49.437941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e0a8cb80-8229-49a0-a917-c06af116cfe5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1279 microversion: 2.1 time: 0.527589 Oct 23 02:11:49.467907 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 18/38] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:48 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1279 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:49.489416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:49.492899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:49.520775 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:49.522605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:49.525150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:49.527910 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:49.529188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:49.530743 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:49.565341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:49.581985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d2463030-d655-4c75-9e50-74d63a8c824a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1272 microversion: 2.1 time: 1.392969 Oct 23 02:11:49.596308 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 21/39] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:48 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1272 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:49.843904 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:49.847472 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:49.855865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:49.856740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:49.873038 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:49.874035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:49.877390 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:49.892026 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:51.190049 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:51.209711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:51.219842 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:51.223894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-df3c56ea-1c4b-4781-a702-7973211ae038 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 1.754173 Oct 23 02:11:51.247633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 19/40] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:49 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:51.257619 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:51.259575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:51.282809 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:51.283626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:51.284224 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:51.287433 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:51.288082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:51.288664 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:51.486284 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:51.488507 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:51.500015 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-40f226de-1686-4706-8a43-b07af5329914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1279 microversion: 2.1 time: 0.250852 Oct 23 02:11:51.512335 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 20/41] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:51 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:51.512432 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-12bc5766-938d-49d8-971d-8c0378a9a666 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 1.672868 Oct 23 02:11:51.523153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 22/42] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:49 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:51.524693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:51.525311 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:51.546575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:51.547245 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:51.550056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:51.550893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:51.551365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:51.551775 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.260391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:52.261245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:52.271377 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:52.271914 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:52.272384 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.273109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:52.274831 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:52.274831 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.340067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:52.356966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2966cf08-8f2a-4773-89a3-1d0eba9302d6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.845070 Oct 23 02:11:52.359276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 21/43] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:51 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:52.531741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:52.532477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:52.542849 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:52.545592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:52.547417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:52.548137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.549012 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:52.550286 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:52.550894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.712393 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:52.726749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:52.736793 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:52.739289 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bc3ded0b-7b58-40b7-8758-469be26d6433 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.483234 Oct 23 02:11:52.741551 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:52 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:11:52.750205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:52.756140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:52.772160 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:52.774050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:52.774764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.777730 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:52.778632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:52.780500 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:52.944233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=28 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:53.133938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:53.153349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ff40b135-4c93-4809-886d-c108ae7e927c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.631073 Oct 23 02:11:53.154220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 22/45] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:52 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:53.282510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:53.295673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-87944772-9de5-48bc-ab26-d453e4a88684 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.552329 Oct 23 02:11:53.296366 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 24/46] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:52 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:53.390018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:53.392708 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:53.402621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:53.403458 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:53.404258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:53.407169 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:53.407953 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:53.408739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:53.772029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:53.774025 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:53.787035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=22 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:53.793263 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:53.796180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:53.796719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:53.797676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:53.806689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:53.807385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:54.060631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:54.074326 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b0630d69-ebdd-4e73-87f4-34e9f57c4b83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.694546 Oct 23 02:11:54.076165 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 23/47] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:53 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:54.169163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:54.177468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:54.178073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:54.187046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:54.187527 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:54.187677 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:54.188075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:54.188772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:54.189218 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:54.189635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:54.198830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:54.200686 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4cbba038-c380-4a47-a503-5e818c42428b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.433052 Oct 23 02:11:54.202681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 25/48] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:53 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:11:54.324442 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:54.325277 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:54.330944 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:54.331964 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:54.339719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:54.340454 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:54.341011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-78550727-f571-4627-bb0b-ca1d2741b707 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.167651 Oct 23 02:11:54.341689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 24/49] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:54 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:11:54.341972 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:54.342740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:54.343433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:54.573744 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:54.581938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e61a6dd8-deaf-45cb-a21c-8783169ae092 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.262874 Oct 23 02:11:54.598200 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 26/50] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:54 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:11:54.698911 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-a122a979-381e-4248-8e6a-3fce6773cac2 req-79c23770-2591-40ab-bd7a-73306d3d5b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973e0362-0459-4084-9f53-776ba26a7fbf", "tag": "54d0f82f-cd89-435a-91df-bd081d1c222c"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:54.708822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a122a979-381e-4248-8e6a-3fce6773cac2 req-79c23770-2591-40ab-bd7a-73306d3d5b93 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:54.709309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a122a979-381e-4248-8e6a-3fce6773cac2 req-79c23770-2591-40ab-bd7a-73306d3d5b93 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:54.709731 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a122a979-381e-4248-8e6a-3fce6773cac2 req-79c23770-2591-40ab-bd7a-73306d3d5b93 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:54.725129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-a122a979-381e-4248-8e6a-3fce6773cac2 req-79c23770-2591-40ab-bd7a-73306d3d5b93 service nova] Creating event network-changed:54d0f82f-cd89-435a-91df-bd081d1c222c for instance 973e0362-0459-4084-9f53-776ba26a7fbf on hv-cinder-86149 Oct 23 02:11:54.733731 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-a122a979-381e-4248-8e6a-3fce6773cac2 req-79c23770-2591-40ab-bd7a-73306d3d5b93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263628 Oct 23 02:11:54.734342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 25/51] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:55.099494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:55.100378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:55.108990 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.109470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.110147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.111034 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.111490 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.111909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.116148 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:55.224097 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=10 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:55.239784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:55.241229 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:55.253344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.254321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.255097 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.256112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.256901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.257332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.262175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:55.271850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-93d8fbbd-b096-4962-9d68-003f33a4c9b7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.176538 Oct 23 02:11:55.272433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 27/52] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:55 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:55.283375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=89 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:11:55.367265 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:55.368334 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:55.383794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.384494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.386212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.387298 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.388352 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.388952 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.413003 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:55.424447 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:55.426358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:55.427632 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5d519b94-1299-478a-9718-b774320a80f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.204665 Oct 23 02:11:55.428197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 26/53] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:55 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:11:55.569313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:55.577627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6c7b4ca4-ef13-461a-95d7-0e25c6834bfc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.217642 Oct 23 02:11:55.578257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 28/54] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:55 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:11:55.608293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:55.609303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:55.617835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.618502 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.619506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.621004 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:55.621465 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:55.622315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:55.774784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:55.782822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-fc75559d-453b-4768-a37a-18f390956f89 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.181365 Oct 23 02:11:55.783390 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 27/55] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:55 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:56.296905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:56.297522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:56.305108 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.305674 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.306283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.306954 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.307970 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.308397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.456978 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:56.457839 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:56.477463 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.478658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:56.479429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.481885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.484473 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.485738 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.487975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.496110 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9e9d1957-c88b-4d29-8a28-e92a0ed9deb2 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.202858 Oct 23 02:11:56.496707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 29/56] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:56 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:56.604907 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:56.605977 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:56.616988 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.617486 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.617926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.618663 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.619121 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:56.619553 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:56.912948 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:56.936486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:56.946153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:56.949346 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-83c8cdcf-7001-4aeb-82b5-3119aebbe9e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.499464 Oct 23 02:11:56.951592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:56 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:56.973810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-9c4b4c00-321c-4d53-98fc-ece3cf678b92 req-dbaaddb9-5108-4d43-b045-f03a62079a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807f959c-521d-49d7-87d0-3a7b22a174a7", "tag": "79f823d3-ca42-4792-96ba-97e67eef504a"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:56.989297 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:56.997943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9c4b4c00-321c-4d53-98fc-ece3cf678b92 req-dbaaddb9-5108-4d43-b045-f03a62079a24 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:56.999160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9c4b4c00-321c-4d53-98fc-ece3cf678b92 req-dbaaddb9-5108-4d43-b045-f03a62079a24 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.002639 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f460514d-35e8-4a8d-872e-c3ea36645b7d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.402206 Oct 23 02:11:57.003647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9c4b4c00-321c-4d53-98fc-ece3cf678b92 req-dbaaddb9-5108-4d43-b045-f03a62079a24 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:57.003849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 30/58] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:56 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:57.033551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-9c4b4c00-321c-4d53-98fc-ece3cf678b92 req-dbaaddb9-5108-4d43-b045-f03a62079a24 service nova] Creating event network-changed:79f823d3-ca42-4792-96ba-97e67eef504a for instance 807f959c-521d-49d7-87d0-3a7b22a174a7 on hv-cinder-86149 Oct 23 02:11:57.034838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:57.035680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:57.058474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-9c4b4c00-321c-4d53-98fc-ece3cf678b92 req-dbaaddb9-5108-4d43-b045-f03a62079a24 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104423 Oct 23 02:11:57.059630 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 29/59] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:57.143514 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:57.144480 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.145554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:57.147658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:57.148680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.150420 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:57.519778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:57.520866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:57.533107 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:57.537457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:57.537938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.539655 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:57.542375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:57.543860 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.544604 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:57.553421 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9fff6b3f-de1b-4592-9aeb-0ed35d1fae44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.548016 Oct 23 02:11:57.554498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 31/60] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:57 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:57.859552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:57.870105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1629caef-a004-4111-b041-eef70d749b14 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.354501 Oct 23 02:11:57.878122 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 30/61] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:57 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:57.978352 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:57.979379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:57.986660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:57.987378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.987965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:57.988913 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:57.989494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:57.990133 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.037629 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:58.041262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:58.058987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.061578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.062355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.066489 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.066984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.068011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.451623 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:58.464360 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:58.465832 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:58.468360 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:58.470067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5588fd22-e8d5-45c3-b3ce-8d4e838ee924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.497104 Oct 23 02:11:58.470729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:57 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:58.476628 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a4cca885-7b7d-4234-9343-abd617a05e8d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.446319 Oct 23 02:11:58.477452 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:58 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:11:58.577761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:58.578319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:58.590179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.590691 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.591134 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.591831 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.592283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.592706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.748423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:58.757000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4d226bdb-4af3-4fa0-ae8d-1ce42618ad5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.183091 Oct 23 02:11:58.763040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 33/64] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:58 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:58.896495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:58.897115 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:58.904335 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.905060 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.905672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:58.906592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:58.907006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:58.907612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.063171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:59.071660 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-30ced1f0-f1d7-4f10-a5a6-d03a6f390cf6 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.179118 Oct 23 02:11:59.072641 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 32/65] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:58 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:59.233742 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-0882b906-9c8e-48c5-b03b-c4ec00f81c76 req-45e95f25-893c-422c-9001-ac3cee9cfcda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933c0983-1ad5-4cbc-9004-2b6ce8ea7c62", "tag": "d969c3a4-3cf5-438b-8549-4df01ca980f6"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:11:59.269970 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-0882b906-9c8e-48c5-b03b-c4ec00f81c76 req-45e95f25-893c-422c-9001-ac3cee9cfcda service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.270720 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-0882b906-9c8e-48c5-b03b-c4ec00f81c76 req-45e95f25-893c-422c-9001-ac3cee9cfcda service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.271343 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-0882b906-9c8e-48c5-b03b-c4ec00f81c76 req-45e95f25-893c-422c-9001-ac3cee9cfcda service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.304963 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-0882b906-9c8e-48c5-b03b-c4ec00f81c76 req-45e95f25-893c-422c-9001-ac3cee9cfcda service nova] Creating event network-changed:d969c3a4-3cf5-438b-8549-4df01ca980f6 for instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 on hv-cinder-86149 Oct 23 02:11:59.318981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-0882b906-9c8e-48c5-b03b-c4ec00f81c76 req-45e95f25-893c-422c-9001-ac3cee9cfcda service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118878) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 23 02:11:59.319553 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-0882b906-9c8e-48c5-b03b-c4ec00f81c76 req-45e95f25-893c-422c-9001-ac3cee9cfcda service nova] Acquired lock "compute-rpcapi-router" {{(pid=118878) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 23 02:11:59.320681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.321153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.321592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.322332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.323375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.323803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.345528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.compute.rpcapi [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 23 02:11:59.347504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] Releasing lock "compute-rpcapi-router" {{(pid=118878) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 23 02:11:59.378364 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a7d95a3d-20c1-4a0f-8b78-2241d5c8b54c None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149148 Oct 23 02:11:59.379012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 34/66] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:11:59.497067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:59.497930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:59.500757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:59.502309 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:59.505835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.506325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.506871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.507609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.508117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.508436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.509720 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.510469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.512229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.513167 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.515449 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.516113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.741124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:59.743187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:59.753798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:59.754873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-76148213-b12f-40fe-9628-b0f06e79af5e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.258096 Oct 23 02:11:59.755278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:11:59.756468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:59 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:11:59.756731 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f4f667b8-b434-4d5e-98a1-e8cc4f97bea4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.265271 Oct 23 02:11:59.757410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 33/68] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:11:59 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:11:59.787153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:11:59.788251 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:11:59.795887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.796383 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.796833 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:11:59.799543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:11:59.800204 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:11:59.800810 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:00.022306 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:00.033262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cd12278f-a1f6-4efb-9c19-c7431a1bef1e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.250258 Oct 23 02:12:00.033852 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 36/69] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:11:59 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:00.095124 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:00.096293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:00.102347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:00.103031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:00.103458 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:00.104685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:00.105297 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:00.105715 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:00.284426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:00.293446 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f64fa2ac-bbd7-4254-9a01-619c8f1382d4 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.202179 Oct 23 02:12:00.294030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 34/70] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:00 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:00.780049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:00.782291 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:00.789017 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:00.790106 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:00.790212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:00.790722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:00.792100 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:00.800618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:00.801395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:00.805125 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:00.805646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:00.805646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:00.805646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:00.812349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:00.813184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:00.813810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:01.129167 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:01.141379 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:01.142872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:01.144040 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-48afbb62-d4e0-443c-b764-898092b18b34 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.360171 Oct 23 02:12:01.148210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:00 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:12:01.155093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:01.156319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:01.163469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:01.163729 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:01.164390 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:01.165034 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:01.165882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:01.166702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:01.167479 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:01.173822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d15e9331-cc72-44aa-992d-7658385725a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.398884 Oct 23 02:12:01.191292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 37/72] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:00 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:01.317468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:01.318119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:01.329027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:01.329763 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:01.330826 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:01.332478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:01.334499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:01.335996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:01.353103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:01.364375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ce6253af-49d4-46bc-8293-72dd91dea529 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.213934 Oct 23 02:12:01.365791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 36/73] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:01 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:01.521453 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:01.534721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e22035da-bb80-41ca-8aa6-e48544121e54 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.221141 Oct 23 02:12:01.536016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 38/74] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:01 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:02.170361 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:02.171636 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:02.183620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:02.184146 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:02.184750 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:02.185495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:02.185938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:02.186597 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:02.199852 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:02.204024 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:02.215113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:02.215843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:02.216506 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:02.217617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:02.218289 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:02.218948 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:02.733078 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:02.743763 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-860a3bac-865b-43d8-a419-16e83fc47a0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.548593 Oct 23 02:12:02.746350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 39/75] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:02 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:02.752171 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:02.752460 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:02.753374 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:02.760783 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:02.761639 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:02.762302 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:02.763281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:02.764031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:02.764656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:02.768512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:02.779067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:02.780101 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b1c3b743-8b0f-4d3f-98e9-223199a91485 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.614905 Oct 23 02:12:02.780658 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 37/76] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:02 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:12:02.795543 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:02.797432 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:02.812741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:02.813606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:02.814181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:02.815100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:02.815726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:02.816150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:02.988752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:03.006187 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fee9bbdc-57f6-477b-9928-033ad5258f25 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.258456 Oct 23 02:12:03.006832 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 40/77] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:02 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:03.021559 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:03.029374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-10b6718d-dc66-4c68-ad85-956a781ed125 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.246761 Oct 23 02:12:03.029955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 38/78] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:02 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:03.770625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-74d6aa90-2c75-4d21-a939-51512d5ef6a2 req-c34e01f0-49b7-4aee-ac13-2fc142cee982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd282d6-75f6-4241-8c5b-d364c031db43", "name": "network-vif-plugged", "status": "completed", "tag": "201fa2da-3990-492d-a724-016abaeaf38a"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:03.773104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:03.773722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:03.781035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:03.781770 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:03.782396 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:03.783301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:03.783942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-74d6aa90-2c75-4d21-a939-51512d5ef6a2 req-c34e01f0-49b7-4aee-ac13-2fc142cee982 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:03.784091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:03.784519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:03.784959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-74d6aa90-2c75-4d21-a939-51512d5ef6a2 req-c34e01f0-49b7-4aee-ac13-2fc142cee982 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:03.785560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-74d6aa90-2c75-4d21-a939-51512d5ef6a2 req-c34e01f0-49b7-4aee-ac13-2fc142cee982 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:03.803890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-74d6aa90-2c75-4d21-a939-51512d5ef6a2 req-c34e01f0-49b7-4aee-ac13-2fc142cee982 service nova] Creating event network-vif-plugged:201fa2da-3990-492d-a724-016abaeaf38a for instance afd282d6-75f6-4241-8c5b-d364c031db43 on hv-cinder-86149 Oct 23 02:12:03.810916 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-74d6aa90-2c75-4d21-a939-51512d5ef6a2 req-c34e01f0-49b7-4aee-ac13-2fc142cee982 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211850 Oct 23 02:12:03.811714 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 41/79] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:03.823220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:03.824144 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:03.832332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:03.833086 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:03.834018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:03.835172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:03.835828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:03.836579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:04.200465 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:04.213739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d48421ec-409e-40d2-8b13-28a6a48013fa tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.447127 Oct 23 02:12:04.215352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 39/80] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:03 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:04.225104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:04.225104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:04.240999 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:04.241791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:04.244417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:04.246054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:04.246618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:04.247900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:04.256511 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:04.270293 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:04.274178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:04.275787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6205a666-25c0-41d0-8caa-f74761b0abad tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.462489 Oct 23 02:12:04.277763 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 42/81] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:03 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:12:04.284810 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:04.285480 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:04.296071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:04.296954 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:04.300443 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:04.301242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:04.302031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:04.303321 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:04.582095 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:04.585740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:04.592304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0aa9c553-284b-4ccf-bab9-ac20102d05ed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.374398 Oct 23 02:12:04.592960 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 40/82] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:04 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:04.594137 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-70372ce0-9974-4db9-90f4-89626e4a9375 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.315235 Oct 23 02:12:04.594886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 43/83] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:04 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:05.240549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:05.240549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:05.251687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:05.252665 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:05.253172 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:05.255779 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:05.256714 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:05.258557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:05.305565 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:05.306170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:05.317872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:05.318595 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:05.321232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:05.324126 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:05.324593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:05.328974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:05.995210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:06.007966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a82f6717-e0bc-4546-b982-a19218199385 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.771742 Oct 23 02:12:06.008567 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 41/84] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:05 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:06.031570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:06.032448 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:06.039321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:06.039996 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:06.040851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:06.041756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:06.042431 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:06.043104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:06.068717 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:06.074941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:06.084468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:06.088939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:06.091428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-27fa730a-b18f-4d11-8d1f-24a81d357031 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.789649 Oct 23 02:12:06.098639 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 44/85] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:05 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:12:06.103649 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:06.116693 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:06.124225 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:06.124722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:06.125157 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:06.125854 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:06.126305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:06.126758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:06.393885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:06.407204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-824a1b0d-99c2-4a36-9a16-51cf5debb99d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.385639 Oct 23 02:12:06.408518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 42/86] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:06 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:06.429539 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:06.439950 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a46b02f4-cfa3-4a26-8650-ce7dbf5846bf tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.339942 Oct 23 02:12:06.440544 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 45/87] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:06 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:07.038798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:07.039611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:07.048259 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:07.049010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:07.049440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:07.051912 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:07.053482 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:07.054093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:07.078184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:07.122985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:07.123844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:07.132068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:07.132760 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:07.133350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:07.134421 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:07.135135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:07.135568 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:07.290380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:07.321070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:07.321997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8f5a7b0c-0075-4ee7-a516-aeeb505b6b9a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.288579 Oct 23 02:12:07.326849 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 43/88] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:07 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:07.331056 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:07.332922 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:07.334312 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-77bac17d-0227-4560-936a-6fe78c7c9f5f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.216422 Oct 23 02:12:07.335061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 46/89] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:07 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:12:07.435794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:07.436575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:07.443516 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:07.443986 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:07.444427 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:07.445428 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:07.445887 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:07.446326 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:07.468933 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:07.469689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:07.479935 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:07.485511 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:07.486361 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:07.487523 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:07.488407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:07.489083 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:07.721618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:07.729778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7ddee3f9-9fd6-467d-a5bf-3cab9d2c2f3b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.299148 Oct 23 02:12:07.730663 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 44/90] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:07 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:07.755055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:07.763789 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5de60c97-9376-4431-bc1f-7cc1053c09e3 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.299462 Oct 23 02:12:07.764377 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 47/91] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:07 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:08.363901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:08.367018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:08.367540 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:08.368347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:08.380593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:08.381079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:08.381503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:08.382556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:08.383031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:08.383445 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:08.384686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:08.385416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:08.386287 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:08.386758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:08.387349 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:08.389247 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:08.628236 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:08.628843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:08.640788 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4a27fbb7-517c-462e-b9e4-014fbf2fd9ac tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.283520 Oct 23 02:12:08.645412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:08.647659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 45/92] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:08 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:08.648297 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:08.650535 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bdf8b124-7491-44e8-a22c-4cfbaf7de977 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.290285 Oct 23 02:12:08.651839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 48/93] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:08 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:12:08.757255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:08.757966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:08.787397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:08.790610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:08.790822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:08.790902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:08.790902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:08.790902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:08.790902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:08.791195 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:08.798282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:08.800441 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:08.800923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:08.801689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:08.802150 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:08.802609 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:09.117354 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:09.133729 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2a5210dc-a85f-426c-b2e8-07fc28099c2b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.381832 Oct 23 02:12:09.135110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 46/94] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:08 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:09.155989 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:09.166417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ab964d18-6281-4330-ad2f-753b634136d0 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.382152 Oct 23 02:12:09.167159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 49/95] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:08 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:09.181743 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-fc0b6eb1-08a4-42ce-9b62-ff293fb4711b req-16893000-3535-49f0-9eba-4f5122dfba21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847628be-0620-4309-99c8-6036d43d26f7", "name": "network-vif-plugged", "status": "completed", "tag": "24fbd91b-949f-4c46-a496-148c4722eb45"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:09.204613 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-fc0b6eb1-08a4-42ce-9b62-ff293fb4711b req-16893000-3535-49f0-9eba-4f5122dfba21 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:09.205090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-fc0b6eb1-08a4-42ce-9b62-ff293fb4711b req-16893000-3535-49f0-9eba-4f5122dfba21 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:09.205513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-fc0b6eb1-08a4-42ce-9b62-ff293fb4711b req-16893000-3535-49f0-9eba-4f5122dfba21 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:09.238866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-fc0b6eb1-08a4-42ce-9b62-ff293fb4711b req-16893000-3535-49f0-9eba-4f5122dfba21 service nova] Creating event network-vif-plugged:24fbd91b-949f-4c46-a496-148c4722eb45 for instance 847628be-0620-4309-99c8-6036d43d26f7 on hv-cinder-86149 Oct 23 02:12:09.253156 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-fc0b6eb1-08a4-42ce-9b62-ff293fb4711b req-16893000-3535-49f0-9eba-4f5122dfba21 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079161 Oct 23 02:12:09.263898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 47/96] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:09.672429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:09.674728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:09.682703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:09.684184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:09.696998 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:09.699875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:09.700860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:09.702263 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:09.703360 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:09.704131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:09.704755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:09.713887 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:09.714400 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:09.714840 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:09.715542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:09.715987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:09.716764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:09.963026 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:09.973902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3832c8be-e496-4ecd-9f09-7c1ddc03e9cb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.306352 Oct 23 02:12:09.986943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:09.993678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 50/97] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:09 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:09.999111 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:10.000756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:10.001911 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-54a7b50d-7fda-4024-8164-d89f9a0ce389 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.326751 Oct 23 02:12:10.002549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 48/98] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:09 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:12:10.157376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:10.158172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:10.169160 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:10.170744 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:10.171874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:10.177122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:10.178819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:10.179288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:10.195869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:10.196544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:10.212721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:10.213579 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:10.214168 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:10.217006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:10.218050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:10.218760 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:10.451386 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:10.461962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:10.474548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-40ef13e7-2e2b-4bee-b89b-c8d1e6db9a42 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.320833 Oct 23 02:12:10.475410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 51/99] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:10 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:10.476931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-462651ab-895a-4b43-b7f4-54397b1aec42 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.285626 Oct 23 02:12:10.487453 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 49/100] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:10 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:11.000651 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:11.001243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:11.018408 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.018926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.019378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.020064 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.020514 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.020932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.035923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:11.038063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:11.053010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.054105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.055339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.057278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.058076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.058825 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.550917 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:11.561660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:11.569696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3b39b08d-9f1a-49e3-be67-4c5e40b4d06b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.572774 Oct 23 02:12:11.582885 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 52/101] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:10 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:11.589704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:11.590901 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-632d2ced-8e00-44cf-ad93-c8ae3bfb708d req-f9b86a65-cc81-4880-98d1-2ea9c505f729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807f959c-521d-49d7-87d0-3a7b22a174a7", "name": "network-vif-plugged", "status": "completed", "tag": "79f823d3-ca42-4792-96ba-97e67eef504a"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:11.594266 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:11.600073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-23759ecb-39a9-426e-9f5f-5041a61b3c60 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.576888 Oct 23 02:12:11.600342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-632d2ced-8e00-44cf-ad93-c8ae3bfb708d req-f9b86a65-cc81-4880-98d1-2ea9c505f729 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.600980 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-632d2ced-8e00-44cf-ad93-c8ae3bfb708d req-f9b86a65-cc81-4880-98d1-2ea9c505f729 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.601743 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-632d2ced-8e00-44cf-ad93-c8ae3bfb708d req-f9b86a65-cc81-4880-98d1-2ea9c505f729 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.610417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 50/102] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:11 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:12:11.614965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-632d2ced-8e00-44cf-ad93-c8ae3bfb708d req-f9b86a65-cc81-4880-98d1-2ea9c505f729 service nova] Creating event network-vif-plugged:79f823d3-ca42-4792-96ba-97e67eef504a for instance 807f959c-521d-49d7-87d0-3a7b22a174a7 on hv-cinder-86149 Oct 23 02:12:11.624626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:11.625245 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:11.632588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-632d2ced-8e00-44cf-ad93-c8ae3bfb708d req-f9b86a65-cc81-4880-98d1-2ea9c505f729 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048363 Oct 23 02:12:11.635287 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 53/103] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:11.639117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.639826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.640408 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:11.641105 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:11.641349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.642253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.642935 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.643555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.664449 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.664946 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.665427 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.666410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:11.666887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:11.667311 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:11.956684 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:11.971097 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-21e0576e-8144-43f4-af8e-93e7cf1cb3ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.359378 Oct 23 02:12:11.971855 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 51/104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:11 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:11.997612 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:12.008254 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-687680a3-9f72-4b69-9024-70027f3e8493 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.371673 Oct 23 02:12:12.009496 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 54/105] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:11 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:12.601965 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:12.604462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:12.613327 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:12.614010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:12.614828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:12.615593 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:12.616170 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:12.616804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:12.635579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:12.636680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:12.643812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:12.644896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:12.645591 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:12.651170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:12.651945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:12.652650 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:12.900746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:12.911587 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4822a952-d58a-4bf5-825d-9efdba9f6567 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.317607 Oct 23 02:12:12.913225 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 52/106] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:12 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:12.940306 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:12.948484 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:12.949956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:12.951080 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3c736158-d20b-46a2-907d-4b4c80378aa9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.320994 Oct 23 02:12:12.951985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 55/107] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:12 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:12:12.996892 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:12.997901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:13.005811 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:13.006587 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:13.007279 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:13.008239 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:13.008942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:13.010141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:13.036622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:13.037914 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:13.046744 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:13.047300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:13.048692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:13.050526 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:13.051554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:13.052322 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:13.467208 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:13.475369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0dc7fabb-bd16-4118-a6fa-d2dce17ce5e4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.482478 Oct 23 02:12:13.487514 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 53/108] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:12 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:13.522755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:13.541319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-713fbcc3-638d-45e5-80ae-8d8d0a566f83 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.509541 Oct 23 02:12:13.541850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 56/109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:13 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:13.652840 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-3ea99c91-b6e0-450e-950a-9a0376e148a2 req-000635bb-585a-4827-a9a4-1f30e2f9e4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933c0983-1ad5-4cbc-9004-2b6ce8ea7c62", "name": "network-vif-plugged", "status": "completed", "tag": "d969c3a4-3cf5-438b-8549-4df01ca980f6"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:13.665441 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-3ea99c91-b6e0-450e-950a-9a0376e148a2 req-000635bb-585a-4827-a9a4-1f30e2f9e4d9 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:13.666586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-3ea99c91-b6e0-450e-950a-9a0376e148a2 req-000635bb-585a-4827-a9a4-1f30e2f9e4d9 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:13.667486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-3ea99c91-b6e0-450e-950a-9a0376e148a2 req-000635bb-585a-4827-a9a4-1f30e2f9e4d9 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:13.682041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-3ea99c91-b6e0-450e-950a-9a0376e148a2 req-000635bb-585a-4827-a9a4-1f30e2f9e4d9 service nova] Creating event network-vif-plugged:d969c3a4-3cf5-438b-8549-4df01ca980f6 for instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 on hv-cinder-86149 Oct 23 02:12:13.688545 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-3ea99c91-b6e0-450e-950a-9a0376e148a2 req-000635bb-585a-4827-a9a4-1f30e2f9e4d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039161 Oct 23 02:12:13.689642 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 54/110] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:13.935264 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:13.935873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:13.945774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:13.947142 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:13.947671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:13.948655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:13.949305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:13.950109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:13.980549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:13.981530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:13.995504 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:13.998936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:13.999492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:14.001298 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:14.004495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:14.005104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:14.210319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:14.223940 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b462d1ca-0dac-436f-83a7-7eb93bf2c264 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.291810 Oct 23 02:12:14.224929 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 57/111] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:13 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:14.251926 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:14.269613 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:14.271270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:14.277477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2a6baad6-87a2-4721-b452-c39c55ca6d7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.304160 Oct 23 02:12:14.278781 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 55/112] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:13 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:12:14.512797 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:14.513812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:14.528366 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:14.529920 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:14.531006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:14.532540 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:14.533305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:14.534197 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:14.568683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:14.569635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:14.580846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:14.583100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:14.583737 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:14.584634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:14.588671 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:14.589332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:14.992898 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:14.994964 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:15.002070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d6fbf464-6d15-4d18-869b-fb7146712b3c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.494724 Oct 23 02:12:15.003249 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 58/113] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:14 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:15.004440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4e0130d3-b38b-4fea-a3c0-8292a12a386a tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.438895 Oct 23 02:12:15.005218 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 56/114] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:14 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:15.250764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:15.252839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:15.262324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:15.263134 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:15.263836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:15.264800 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:15.265617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:15.266282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:15.304821 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:15.306180 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:15.316851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:15.317845 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:15.318380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:15.319245 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:15.319790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:15.320301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:15.526735 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:15.530686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:15.535624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-53b64bc5-e670-4a30-93eb-d611353b8f48 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.290722 Oct 23 02:12:15.536286 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 59/115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:15 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:15.543174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:15.547776 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:15.549158 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a17c601b-30a4-40d0-b264-94673b0a8c48 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1406 microversion: 2.20 time: 0.248777 Oct 23 02:12:15.550088 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 57/116] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:15 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:12:16.028439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:16.029051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:16.038819 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:16.039827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:16.052121 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.052938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.054372 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.055967 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.056558 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.057292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.057738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.058193 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.058926 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.060159 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.060703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.061313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.320634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:16.330043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3cc8e245-c102-417a-bd0b-50637fd5ae6e tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1314 microversion: 2.1 time: 0.296335 Oct 23 02:12:16.331146 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 58/117] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:16 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:16.339672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:16.347660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6e06ee16-3040-4687-8e9e-e1b2be69e42c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.323775 Oct 23 02:12:16.348335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 60/118] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:16 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:16.563900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:16.564496 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:16.578659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.578659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.578659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.578659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.579020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.579020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.579409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:16.580859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:16.591872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.593202 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.594310 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.595218 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.595874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.596844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.784161 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:16.793652 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5b760f1f-8959-401c-90d9-04319cc101c7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.233337 Oct 23 02:12:16.794316 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 59/119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:16 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:16.799720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-d1999923-90de-4fa5-a7e1-431555061133 req-ff9eb3a1-be32-4164-8738-c001501840ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973e0362-0459-4084-9f53-776ba26a7fbf", "name": "network-vif-plugged", "status": "completed", "tag": "54d0f82f-cd89-435a-91df-bd081d1c222c"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:16.811095 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d1999923-90de-4fa5-a7e1-431555061133 req-ff9eb3a1-be32-4164-8738-c001501840ac service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.811920 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d1999923-90de-4fa5-a7e1-431555061133 req-ff9eb3a1-be32-4164-8738-c001501840ac service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.812613 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d1999923-90de-4fa5-a7e1-431555061133 req-ff9eb3a1-be32-4164-8738-c001501840ac service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.816467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:16.826217 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-d1999923-90de-4fa5-a7e1-431555061133 req-ff9eb3a1-be32-4164-8738-c001501840ac service nova] Creating event network-vif-plugged:54d0f82f-cd89-435a-91df-bd081d1c222c for instance 973e0362-0459-4084-9f53-776ba26a7fbf on hv-cinder-86149 Oct 23 02:12:16.828540 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:16.830006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:16.832664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-aad4080c-cca8-4c91-afc6-bf686f56e4c3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1598 microversion: 2.20 time: 0.259266 Oct 23 02:12:16.833725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 61/120] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:12:16 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1598 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:12:16.834523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-d1999923-90de-4fa5-a7e1-431555061133 req-ff9eb3a1-be32-4164-8738-c001501840ac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037740 Oct 23 02:12:16.835398 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 60/121] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:16.886071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:16.886842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:16.893696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=84 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:16.895602 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.896467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.897098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.898042 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:16.898700 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:16.900140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:16.960469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:17.037421 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c1dfa61d-1f6b-430a-b146-da837e11ddbd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.157613 Oct 23 02:12:17.038125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 62/122] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 23 02:12:16 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:12:17.356134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:17.356998 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:17.387424 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:17.388560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:17.402741 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:17.405840 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:17.407075 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:17.407809 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:17.408436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:17.409412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:17.410132 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:17.411142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:17.412005 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:17.412654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:17.413867 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:17.417856 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:17.698591 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:17.709324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1e8ca9c1-fab6-47a9-b845-2432d6d6edb4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.336995 Oct 23 02:12:17.710181 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 63/123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:17 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:17.737091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:17.746822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-56c87e05-8fe5-49e6-ae53-a2f13faba3f5 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1501 microversion: 2.1 time: 0.396065 Oct 23 02:12:17.747550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 61/124] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:17 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1501 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:17.818509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:17.819557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:17.827961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:17.828828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:17.829998 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:17.831604 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:17.832242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:17.832871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:18.062428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:18.073610 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-028035d6-8103-4ae6-981d-c014712e1953 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.259577 Oct 23 02:12:18.075930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 64/125] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:17 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:18.743533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:18.744102 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-807c7aff-9ce3-49a1-9511-66924def0b8f req-229bce49-7d03-49b4-b542-76782a10c720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847628be-0620-4309-99c8-6036d43d26f7", "tag": "24fbd91b-949f-4c46-a496-148c4722eb45"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:18.747672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:18.754257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-807c7aff-9ce3-49a1-9511-66924def0b8f req-229bce49-7d03-49b4-b542-76782a10c720 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:18.755068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-807c7aff-9ce3-49a1-9511-66924def0b8f req-229bce49-7d03-49b4-b542-76782a10c720 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:18.755673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-807c7aff-9ce3-49a1-9511-66924def0b8f req-229bce49-7d03-49b4-b542-76782a10c720 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:18.767426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:18.768076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:18.768609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:18.769437 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:18.769982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:18.772393 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:18.772969 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-807c7aff-9ce3-49a1-9511-66924def0b8f req-229bce49-7d03-49b4-b542-76782a10c720 service nova] Creating event network-changed:24fbd91b-949f-4c46-a496-148c4722eb45 for instance 847628be-0620-4309-99c8-6036d43d26f7 on hv-cinder-86149 Oct 23 02:12:18.779174 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-807c7aff-9ce3-49a1-9511-66924def0b8f req-229bce49-7d03-49b4-b542-76782a10c720 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039828 Oct 23 02:12:18.780414 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 65/126] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:18.793509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:18.975481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:18.983519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0b5c2daf-696f-4a78-822f-a456721370a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.253122 Oct 23 02:12:18.984094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 62/127] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:18 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:19.099300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:19.102466 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:19.114307 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:19.115176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:19.116378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:19.117201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:19.119596 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:19.120185 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:19.351106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:19.360211 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c386b867-b66f-4359-8677-a77df3414343 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.264954 Oct 23 02:12:19.361305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 66/128] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:19 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:20.008222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:20.008824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:20.014791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:20.015272 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:20.015698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:20.016387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:20.016836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:20.017256 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:20.243571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:20.251518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4835b282-b5fe-4273-b97f-7f8d3361b4de tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.247344 Oct 23 02:12:20.252161 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 63/129] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:20 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:20.371672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a03132e-63f8-447a-8649-9402396c7e46"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:20.374039 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:20.380176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:20.380662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:20.381202 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:20.381797 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:20.382251 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:20.382692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:20.388492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:20.388492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:20.395164 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:20.395859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:20.396425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:20.397165 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:20.397836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:20.398311 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:20.551842 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:20.559794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-026d6ca4-5de7-46ea-b235-e3625a9b5376 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.179480 Oct 23 02:12:20.560365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 64/130] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:20 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:21.276142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:21.276761 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:21.283786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:21.284267 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:21.284698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:21.285414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:21.285863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:21.286281 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:21.432372 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:21.440005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f59bbd11-dc33-4e14-a00a-f115b3f07c7c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.168172 Oct 23 02:12:21.440593 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 65/131] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:21 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:21.582947 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:21.583510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:21.589967 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:21.590470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:21.590971 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:21.591696 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:21.592089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:21.592539 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:21.723166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:21.731635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-27a37261-8976-4b2d-b8f3-6a2ce15b5451 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.152655 Oct 23 02:12:21.732206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 66/132] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:21 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:22.464331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:22.464946 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:22.470765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:22.471243 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:22.471667 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:22.472344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:22.472794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:22.473204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:22.630694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:22.643323 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bb2e8ed5-f4fa-4993-8456-c9c2d8006b2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.183910 Oct 23 02:12:22.651939 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 67/133] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:22 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:22.755212 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:22.755858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:22.758277 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=91 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:22.764838 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:22.765358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:22.765788 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:22.766495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:22.766948 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:22.767366 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:22.893237 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:22.902160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8b60bb4e-1102-40d1-bf6a-607335caddf1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.150692 Oct 23 02:12:22.902881 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 68/134] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:22 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:23.668479 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:23.669067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:23.675470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:23.675944 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:23.676375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:23.677042 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:23.677484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:23.677899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:23.808909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:23.816491 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a919db98-39bd-4acf-a703-f823579ac8c7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.152441 Oct 23 02:12:23.817054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 69/135] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:23 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:23.925702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:23.926233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:23.932991 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:23.933471 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:23.933899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:23.934635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:23.935079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:23.935494 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:24.064740 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:24.077258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-80e87bbb-1916-4cbc-bc31-6d00517023f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1321 microversion: 2.1 time: 0.155729 Oct 23 02:12:24.078662 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 70/136] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:23 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:24.841509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:24.842933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:24.849151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:24.849629 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:24.850059 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:24.850765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:24.851240 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:24.851756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:24.979066 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:24.986861 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5c4adb0a-3215-4b1f-a9db-876b16eb3ea4 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1363 microversion: 2.1 time: 0.149209 Oct 23 02:12:24.987440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 71/137] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:24 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:25.100304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:25.100842 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:25.107360 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:25.107835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:25.108264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:25.108935 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:25.109388 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:25.109806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:25.310677 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:25.318487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4ed12b0e-103d-4859-9fb4-0e05dad08e12 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1515 microversion: 2.1 time: 0.222068 Oct 23 02:12:25.319166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 72/138] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:25 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:25.341878 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:25.344308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:25.350118 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:25.350702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:25.351627 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:25.352355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:25.352878 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:25.353269 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:25.415084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lazy-loading 'flavor' on Instance uuid 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:12:25.548067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6331051f-7251-449d-b299-5b02b5ef0443 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62/action" status: 200 len: 32 microversion: 2.1 time: 0.209606 Oct 23 02:12:25.552737 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 73/139] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:12:25 2022] POST /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62/action => generated 32 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 02:12:25.560688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:25.561344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:25.567706 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:25.568264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:25.568696 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:25.569386 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:25.570341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:25.571155 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:25.969655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a6543122-aed4-451a-8979-5551f67aa13b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "POST /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.602009 Oct 23 02:12:25.970288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 67/140] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:12:20 2022] POST /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7/os-volume_attachments => generated 194 bytes in 5604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:25.983396 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:25.994193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9d0209c0-6f4a-4245-8078-6cde566f9931 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.440055 Oct 23 02:12:25.994831 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 74/141] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:25 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:26.015775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:26.016474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:26.022836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:26.024014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:26.024457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:26.025147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:26.025592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:26.026190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:26.158866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:26.167072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e2ab68c1-86da-4686-99c7-85ed4802f489 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1549 microversion: 2.1 time: 0.158739 Oct 23 02:12:26.167643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 68/142] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:26 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:26.190626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:26.191119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:26.197030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:26.197543 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:26.198008 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:26.198728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:26.199178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:26.199789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:26.277366 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0a26c620-5a7c-4f89-aae2-210a4fb1ac5b tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090543 Oct 23 02:12:26.277996 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 75/143] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 23 02:12:26 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:27.021382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:27.022031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:27.028902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:27.029391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:27.029856 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:27.030583 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:27.031037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:27.031461 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:27.357572 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1084888918", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "networks": [{"uuid": "4d27eda4-500e-483b-bb5d-00efa68e057f"}]}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:27.415797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] validate_networks() for [('4d27eda4-500e-483b-bb5d-00efa68e057f', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:12:27.707404 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:27.716208 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c2f6579d-76ae-4678-9fa0-87ce1687a3f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.698899 Oct 23 02:12:27.716884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 69/144] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:27 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:28.716075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:12:28.716591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:12:28.716990 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:12:28.717730 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:12:28.718146 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:12:28.730351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:28.730909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:28.731342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:28.733746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:28.734223 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:28.734692 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:28.738492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:28.739105 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:28.749620 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:28.750113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:28.750572 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:28.751275 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:28.751712 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:28.753333 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:28.765588 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Getting quotas for project e84f012d59214a6bb6e7f5490bfb2bfc. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:12:28.772420 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Getting quotas for user 04ee886aeea740428a58a513600fc9b8 and project e84f012d59214a6bb6e7f5490bfb2bfc. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:12:28.792195 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:12:28.797565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:12:28.866300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-93ac6942-6699-4b83-9570-99df519046bf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.512318 Oct 23 02:12:28.868881 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 76/145] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:12:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:12:28.878486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-d0a5e688-c60a-4877-a636-a874812a248c req-8b5223c6-4e67-4f34-b38f-00ff91aa53bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973e0362-0459-4084-9f53-776ba26a7fbf", "tag": "54d0f82f-cd89-435a-91df-bd081d1c222c"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:28.899541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d0a5e688-c60a-4877-a636-a874812a248c req-8b5223c6-4e67-4f34-b38f-00ff91aa53bb service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:28.900010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d0a5e688-c60a-4877-a636-a874812a248c req-8b5223c6-4e67-4f34-b38f-00ff91aa53bb service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:28.900432 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d0a5e688-c60a-4877-a636-a874812a248c req-8b5223c6-4e67-4f34-b38f-00ff91aa53bb service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:28.925648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-d0a5e688-c60a-4877-a636-a874812a248c req-8b5223c6-4e67-4f34-b38f-00ff91aa53bb service nova] Creating event network-changed:54d0f82f-cd89-435a-91df-bd081d1c222c for instance 973e0362-0459-4084-9f53-776ba26a7fbf on hv-cinder-86149 Oct 23 02:12:28.934754 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-d0a5e688-c60a-4877-a636-a874812a248c req-8b5223c6-4e67-4f34-b38f-00ff91aa53bb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064309 Oct 23 02:12:28.935631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 77/146] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:28.942075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-48cb758f-77c1-4326-b8bd-c138677c6db1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:28.942075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-48cb758f-77c1-4326-b8bd-c138677c6db1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:29.358065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-48cb758f-77c1-4326-b8bd-c138677c6db1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:29.365593 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-48cb758f-77c1-4326-b8bd-c138677c6db1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1214 microversion: 2.1 time: 0.428803 Oct 23 02:12:29.366310 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 78/147] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:28 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1214 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:29.465315 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:29.474293 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8d8379b7-ad2e-4037-acd7-c88912e25f92 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.739576 Oct 23 02:12:29.477872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 70/148] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:28 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:30.390381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:30.391845 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:30.407173 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:30.407679 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:30.408122 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:30.408822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:30.412159 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:30.414622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:30.436320 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:30.501803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:30.502410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:30.508978 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:30.509460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:30.509946 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:30.510679 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:30.511164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:30.511588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:30.514469 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:30.524271 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6b415521-b129-480d-869e-4c25ff128e64 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1266 microversion: 2.1 time: 0.138726 Oct 23 02:12:30.525199 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 79/149] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:30 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:30.649359 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:30.661689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2eceb8dd-ab64-485f-acba-e3f400417fbe tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.163871 Oct 23 02:12:30.662711 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 71/150] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:30 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:31.549020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:31.550087 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:31.557829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:31.558393 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:31.559106 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:31.570996 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:31.571550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:31.573549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:31.657624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:31.668635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-78c56538-7a5c-46b4-9cdf-d204c0147eb9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1272 microversion: 2.1 time: 0.124275 Oct 23 02:12:31.669347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 80/151] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:31 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:31.697014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:31.700190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:31.707670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:31.708376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:31.709110 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:31.710898 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:31.711719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:31.712842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:31.957057 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:31.967446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-03bf83f7-e758-4ada-9e03-8ac4285c0292 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.274341 Oct 23 02:12:31.968012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 72/152] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:31 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:32.696265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:32.696850 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:32.703093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:32.703578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:32.704014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:32.704691 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:32.705137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:32.705552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:32.909183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:32.917332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b7774a28-9783-47aa-9efc-e41337e0abea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.225498 Oct 23 02:12:32.917900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 81/153] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:32 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:32.992008 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:32.992629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:32.999430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:32.999916 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:33.000396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:33.001192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:33.001652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:33.002090 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:33.034706 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-25e6c0ab-291a-4995-ba5b-5f2f29e141f8 req-5d6afa07-6947-474a-8820-cfffaa19d0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f2a875f-e253-497b-a316-729833572690", "tag": "04e7e7de-2c70-4c7e-ac6f-c1a8f4d25e2e"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:33.044493 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-25e6c0ab-291a-4995-ba5b-5f2f29e141f8 req-5d6afa07-6947-474a-8820-cfffaa19d0b6 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:33.044972 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-25e6c0ab-291a-4995-ba5b-5f2f29e141f8 req-5d6afa07-6947-474a-8820-cfffaa19d0b6 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:33.045402 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-25e6c0ab-291a-4995-ba5b-5f2f29e141f8 req-5d6afa07-6947-474a-8820-cfffaa19d0b6 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:33.057586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-25e6c0ab-291a-4995-ba5b-5f2f29e141f8 req-5d6afa07-6947-474a-8820-cfffaa19d0b6 service nova] Creating event network-changed:04e7e7de-2c70-4c7e-ac6f-c1a8f4d25e2e for instance 7f2a875f-e253-497b-a316-729833572690 on hv-cinder-86149 Oct 23 02:12:33.062753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-25e6c0ab-291a-4995-ba5b-5f2f29e141f8 req-5d6afa07-6947-474a-8820-cfffaa19d0b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031716 Oct 23 02:12:33.063352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 82/154] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:33.159416 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:33.167495 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5201c49f-0cd7-431e-b64b-a829cad7e7a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.180103 Oct 23 02:12:33.168055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 73/155] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:32 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:33.941744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:33.942378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:33.949229 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:33.949706 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:33.950139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:33.950847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:33.951300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:33.951721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:34.082002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:34.090143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-04252dd5-4afc-4484-bdc1-28ca3a7ce88e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.152663 Oct 23 02:12:34.090801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 83/156] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:33 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:34.190922 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:34.191524 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:34.199042 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:34.199444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:34.199872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:34.200549 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:34.200994 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:34.201405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:34.329931 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:34.337599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7731f449-7315-4270-8047-2ea880fd043a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.150492 Oct 23 02:12:34.338163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 74/157] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:34 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:35.113374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:35.114123 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:35.120850 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:35.121333 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:35.121767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:35.122485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:35.122933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:35.123351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:35.259888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:35.267555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-14449471-75e9-406e-8b2b-8ff83dd80552 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.158153 Oct 23 02:12:35.268119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 84/158] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:35 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:35.360652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:35.361261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:35.367877 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:35.368355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:35.368790 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:35.369468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:35.369918 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:35.370339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:35.497049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:35.504644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-dcf1b5bf-2d24-49f5-8f09-8c7da0848de4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.147771 Oct 23 02:12:35.505212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 75/159] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:35 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:36.291447 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:36.292136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:36.298625 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:36.299103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:36.299549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:36.300222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:36.300711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:36.301177 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:36.431264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:36.438740 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d72c9028-d16e-4000-be0b-f737d4e94c48 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.151713 Oct 23 02:12:36.439303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 85/160] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:36 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:36.528281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:36.528896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:36.535424 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:36.536101 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:36.536548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:36.537459 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:36.538598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:36.539108 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:36.667375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:36.675383 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8351c0d1-08b3-4a17-aab5-cfb254470200 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.150979 Oct 23 02:12:36.675959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 76/161] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:36 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:37.461531 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:37.462132 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:37.467977 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:37.468448 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:37.468871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:37.469538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:37.469974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:37.470387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:37.599708 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:37.607939 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d647a0c7-c090-4808-9411-c53834efda32 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.150716 Oct 23 02:12:37.608518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 86/162] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:37 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:37.698669 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:37.699278 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:37.705713 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:37.706195 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:37.706657 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:37.707356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:37.707807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:37.708234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:37.838274 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:37.846145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-04c91f67-7102-41ba-ac75-a9c8acb17799 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.151544 Oct 23 02:12:37.846837 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 77/163] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:37 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:38.633329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:38.634014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:38.639885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:38.640414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:38.640899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:38.641601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:38.642090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:38.642549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:38.742654 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:38.776273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:38.783982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0cbabdcc-d793-44b7-b0fa-aff19dd09b76 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.155978 Oct 23 02:12:38.784796 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 87/164] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:38 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:38.872101 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:38.872744 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:38.879503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:38.880003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:38.880434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:38.881146 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:38.881592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:38.882034 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:38.903903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:39.098705 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:39.108024 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f729e943-c06a-4e15-bbf1-3ab6e7e8e609 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.241145 Oct 23 02:12:39.108735 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 78/165] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:38 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:39.807848 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:39.808453 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:39.810289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=8 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:39.815369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:39.815930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:39.816270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:39.816948 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:39.817387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:39.817805 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.041123 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:40.049951 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5933bae0-77c1-40df-82b4-7cfc080d82b9 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.246372 Oct 23 02:12:40.050878 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 88/166] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:39 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:40.131778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:40.132431 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:40.139717 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:40.140204 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:40.140848 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.141708 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:40.143493 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:40.143923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.288476 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:40.297953 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-422e0fe0-0b57-4f80-b418-a9f47227faa9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.169972 Oct 23 02:12:40.298819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 79/167] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:40 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:40.606036 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:40.606871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:40.612695 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:40.613176 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:40.613611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.614294 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:40.614767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:40.615183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.641473 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Going to try to terminate instance {{(pid=118877) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:12:40.735499 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0220d4d4-e74c-4cb4-a9cb-d2ef11fefbeb tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "DELETE /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 204 len: 0 microversion: 2.1 time: 0.133033 Oct 23 02:12:40.736086 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 89/168] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:12:40 2022] DELETE /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:12:40.745658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:40.746354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:40.752319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:40.752903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:40.753409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.754103 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:40.754575 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:40.755000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:40.910132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:40.919064 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e6ba767b-231b-49de-89f7-acf12c99e563 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1553 microversion: 2.1 time: 0.178546 Oct 23 02:12:40.919709 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 80/169] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:40 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:41.074538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:41.075233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:41.080982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:41.081452 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:41.081879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:41.082575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:41.083016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:41.083487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:41.220905 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:41.230704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6385de31-e8de-4b87-94e8-747ead74e145 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.161525 Oct 23 02:12:41.231273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 90/170] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:41 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:41.321689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:41.322833 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:41.329573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:41.330126 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:41.330663 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:41.331415 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:41.331962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:41.332444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:41.469824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:41.478582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f1afed6f-6320-46df-ae89-c44c08e1fbad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.161353 Oct 23 02:12:41.479192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 81/171] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:41 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:41.945080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:41.945798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:41.951856 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:41.952344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:41.952769 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:41.953517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:41.954033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:41.954646 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:42.134907 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:42.144133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-87ea293b-6a7f-49e2-94c5-44844a9f0d0b tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1553 microversion: 2.1 time: 0.203309 Oct 23 02:12:42.144894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 91/172] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:41 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:42.254375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:42.255367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:42.262336 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:42.262882 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:42.263318 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:42.264017 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:42.264475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:42.264900 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:42.400793 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:42.408847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c5e46efe-5267-40db-9dbb-0c72b02eeaea tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.159376 Oct 23 02:12:42.409614 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 82/173] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:42 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:42.501782 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:42.502428 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:42.508691 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:42.509174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:42.509612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:42.510299 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:42.510776 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:42.511206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:42.649573 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:42.662557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d986bee6-06d0-4463-ba98-17bcd7ebc712 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.164648 Oct 23 02:12:42.663436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 92/174] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:42 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:43.168548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:43.169161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:43.175442 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:43.175926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:43.176361 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:43.177049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:43.177500 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:43.177922 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:43.312932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:43.321146 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e4d18100-6341-45a8-b9f9-1332d778d204 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1553 microversion: 2.1 time: 0.156416 Oct 23 02:12:43.321947 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 83/175] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:43 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:43.434154 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:43.434858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:43.441090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:43.441612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:43.442103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:43.442899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:43.443342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:43.443799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:43.574981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:43.582479 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-658e5e4a-4045-4534-874e-618411ff093a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.152233 Oct 23 02:12:43.583048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 93/176] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:43 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:43.688573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:43.689664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:43.698396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:43.698951 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:43.699398 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:43.700089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:43.700543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:43.700976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:43.831512 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:43.840122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-58d1f1f6-1b91-4839-8847-a299a5eaacad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.155973 Oct 23 02:12:43.840701 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 84/177] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:43 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:44.344776 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:44.345487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:44.351828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:44.352509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:44.352943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:44.353621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:44.354071 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:44.354511 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:44.508714 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:44.518973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-93abd454-2a69-40fd-8bdc-ecb2d93fcc73 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1553 microversion: 2.1 time: 0.177872 Oct 23 02:12:44.519670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 94/178] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:44 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:44.607252 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:44.608082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:44.614759 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:44.615320 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:44.615971 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:44.617314 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:44.617828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:44.618253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:44.765255 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:44.776056 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a7f0ed18-49a9-4fe1-8ecb-fa0d70f4f98a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.173547 Oct 23 02:12:44.777010 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 85/179] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:44 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:44.866126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:44.867359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:44.874971 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:44.875583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:44.876400 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:44.878297 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:44.878950 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:44.880006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:44.886354 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:45.320022 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:45.327692 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e128c8cf-d86d-44bb-b334-b981a55f122d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.467854 Oct 23 02:12:45.328263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 95/180] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:44 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:45.543124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:45.543746 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:45.552389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:45.552389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:45.552389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:45.552389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:45.552702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:45.552702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:45.727599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:45.736397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e4f52114-fa45-4a00-ae4e-5755f6635a2f tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1553 microversion: 2.1 time: 0.197049 Oct 23 02:12:45.737234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 86/181] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:45 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:45.800997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:45.802799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:45.811863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:45.812687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:45.813610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:45.814822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:45.815591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:45.816959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:46.057312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:46.070154 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a9d03e3e-559b-4d51-9439-89f44ff05969 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.274300 Oct 23 02:12:46.084448 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 96/182] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:45 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:46.353597 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:46.356378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:46.370480 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:46.374729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:46.375531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:46.378759 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:46.379487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:46.380375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:46.421248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-1b702868-330c-45b4-84ef-73143d78ddf0 req-21d858c9-6abc-4540-82b4-4430ae21ec57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807f959c-521d-49d7-87d0-3a7b22a174a7", "name": "network-vif-deleted", "tag": "79f823d3-ca42-4792-96ba-97e67eef504a"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:46.441406 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1b702868-330c-45b4-84ef-73143d78ddf0 req-21d858c9-6abc-4540-82b4-4430ae21ec57 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:46.442872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1b702868-330c-45b4-84ef-73143d78ddf0 req-21d858c9-6abc-4540-82b4-4430ae21ec57 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:46.447633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1b702868-330c-45b4-84ef-73143d78ddf0 req-21d858c9-6abc-4540-82b4-4430ae21ec57 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:46.460149 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-1b702868-330c-45b4-84ef-73143d78ddf0 req-21d858c9-6abc-4540-82b4-4430ae21ec57 service nova] Creating event network-vif-deleted:79f823d3-ca42-4792-96ba-97e67eef504a for instance 807f959c-521d-49d7-87d0-3a7b22a174a7 on hv-cinder-86149 Oct 23 02:12:46.465320 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-1b702868-330c-45b4-84ef-73143d78ddf0 req-21d858c9-6abc-4540-82b4-4430ae21ec57 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048464 Oct 23 02:12:46.467116 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 97/183] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:46.659233 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:46.672429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ca221f33-da72-48d8-b371-53c89fd7404f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.325076 Oct 23 02:12:46.673903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 87/184] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:46 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:46.767357 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:46.769197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:46.776265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:46.776897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:46.777511 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:46.778237 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:46.778727 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:46.779154 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:46.858823 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5495217023fc44eab2fa73552db6b3f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd296608fc23c4667b5173c0f3fe1697e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:46.871987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b3c3e6e7-fa4e-4ae0-92d7-93f4a2424813 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 200 len: 1345 microversion: 2.1 time: 0.110761 Oct 23 02:12:46.873046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 98/185] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:46 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 1345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:47.098838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:47.099465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:47.109377 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=52 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:47.111534 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.112147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.113125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.113849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.114372 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.114860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.319720 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:47.332330 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-39b7c2c8-817b-48a5-b99b-7a50443c9ea0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.238692 Oct 23 02:12:47.333773 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 88/186] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:47 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:47.474151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-f58d9889-c2b1-459b-b72a-23585fbfc496 req-55808f15-688f-4ebe-8152-d311f7413916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2a875f-e253-497b-a316-729833572690", "name": "network-vif-plugged", "status": "completed", "tag": "04e7e7de-2c70-4c7e-ac6f-c1a8f4d25e2e"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:47.499753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f58d9889-c2b1-459b-b72a-23585fbfc496 req-55808f15-688f-4ebe-8152-d311f7413916 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.510143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f58d9889-c2b1-459b-b72a-23585fbfc496 req-55808f15-688f-4ebe-8152-d311f7413916 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.510808 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f58d9889-c2b1-459b-b72a-23585fbfc496 req-55808f15-688f-4ebe-8152-d311f7413916 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.539100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-f58d9889-c2b1-459b-b72a-23585fbfc496 req-55808f15-688f-4ebe-8152-d311f7413916 service nova] Creating event network-vif-plugged:04e7e7de-2c70-4c7e-ac6f-c1a8f4d25e2e for instance 7f2a875f-e253-497b-a316-729833572690 on hv-cinder-86149 Oct 23 02:12:47.548215 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-f58d9889-c2b1-459b-b72a-23585fbfc496 req-55808f15-688f-4ebe-8152-d311f7413916 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083713 Oct 23 02:12:47.549439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 99/187] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:12:47.696619 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:47.697236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:47.704188 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.704605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.705065 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.705782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.706263 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.706704 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.898986 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:47.900015 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:47.906662 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.907338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.907871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.908681 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:47.909198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:47.909811 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:47.926143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] HTTP exception thrown: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Request method failure captured: Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 HTTP/1.1 Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLU85IRYjZptuPNT88baLoPboWZrdjHrmDe3-AsHd5pG3D3259QLm1BCVC0s7eeiSrlSdOsgiOTd7L8qBLdjcrWDhjjbQH2iZb2771KBY_00fA4tome4w3CqbN7OnojqTAF4g81kiaEjo8HLiq8dSyRjp7Qkmiq3T6Fhmybulvkn9U Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: d296608fc23c4667b5173c0f3fe1697e Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:12:47.934348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: d296608fc23c4667b5173c0f3fe1697e Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-DeleteServersTestJSON-660417526-project Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 5495217023fc44eab2fa73552db6b3f2 Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-DeleteServersTestJSON-660417526-project Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:47.935874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '807f959c-521d-49d7-87d0-3a7b22a174a7'} Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:12:47.936732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:47.937846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:47.938836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Returning 404 to user: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:12:47.938836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f68143d1-d0fa-4746-83de-f85947a75e92 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 404 len: 111 microversion: 2.1 time: 0.041713 Oct 23 02:12:47.938836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 100/188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:47 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:12:48.060362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:48.062556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:48.064250 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:48.069365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:48.069846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:48.070277 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:48.070989 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:48.071430 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:48.071842 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:48.072850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-95bbd484-b065-4be9-93e7-c620dcde5091 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.380664 Oct 23 02:12:48.073498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 89/189] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:47 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:48.084655 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] HTTP exception thrown: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Request method failure captured: Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7/os-volume_attachments HTTP/1.1 Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLU85IRYjZptuPNT88baLoPboWZrdjHrmDe3-AsHd5pG3D3259QLm1BCVC0s7eeiSrlSdOsgiOTd7L8qBLdjcrWDhjjbQH2iZb2771KBY_00fA4tome4w3CqbN7OnojqTAF4g81kiaEjo8HLiq8dSyRjp7Qkmiq3T6Fhmybulvkn9U Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: d296608fc23c4667b5173c0f3fe1697e Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:12:48.103112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: d296608fc23c4667b5173c0f3fe1697e Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-DeleteServersTestJSON-660417526-project Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 5495217023fc44eab2fa73552db6b3f2 Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-DeleteServersTestJSON-660417526-project Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:48.104550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'server_id': '807f959c-521d-49d7-87d0-3a7b22a174a7'} Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:12:48.105550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:48.106934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:48.108332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Returning 404 to user: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:12:48.108332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-962e313c-c435-4537-8657-255b31dac133 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048246 Oct 23 02:12:48.108332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 101/190] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:12:48 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:12:48.358858 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:48.359466 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:48.365985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:48.366494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:48.366933 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:48.367613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:48.368059 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:48.368477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:48.501616 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:48.509581 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2b1bf30b-b59d-4494-96bb-fddaa723ab20 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.154525 Oct 23 02:12:48.510145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 90/191] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:48 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:49.096341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:49.096891 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:49.102979 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:49.103459 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:49.103918 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:49.104600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:49.105047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:49.105498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:49.231318 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:49.238870 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-51a82d4f-abf2-4633-93c3-3e10345ed91f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.146446 Oct 23 02:12:49.239440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 102/192] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:49 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:49.309251 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:49.309757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:49.315674 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:49.316158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:49.316595 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:49.317286 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:49.317759 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:49.318168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:49.331680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] HTTP exception thrown: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Request method failure captured: Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: DELETE /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 HTTP/1.1 Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLU85IRYjZptuPNT88baLoPboWZrdjHrmDe3-AsHd5pG3D3259QLm1BCVC0s7eeiSrlSdOsgiOTd7L8qBLdjcrWDhjjbQH2iZb2771KBY_00fA4tome4w3CqbN7OnojqTAF4g81kiaEjo8HLiq8dSyRjp7Qkmiq3T6Fhmybulvkn9U Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: d296608fc23c4667b5173c0f3fe1697e Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:12:49.336814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: d296608fc23c4667b5173c0f3fe1697e Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-DeleteServersTestJSON-660417526-project Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 5495217023fc44eab2fa73552db6b3f2 Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-DeleteServersTestJSON-660417526-project Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.338168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '807f959c-521d-49d7-87d0-3a7b22a174a7'} Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:12:49.339007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.340231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.341573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Returning 404 to user: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:12:49.341573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b8757f07-fd6b-4b69-8f07-d7f708ef1816 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "DELETE /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 404 len: 111 microversion: 2.1 time: 0.032843 Oct 23 02:12:49.341573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 91/193] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:12:49 2022] DELETE /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:12:49.346749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:49.347302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] [instance: 807f959c-521d-49d7-87d0-3a7b22a174a7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:49.353782 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:49.354257 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:49.354744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:49.355419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:49.355869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:49.356313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:49.371100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] HTTP exception thrown: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Request method failure captured: Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 HTTP/1.1 Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLU85IRYjZptuPNT88baLoPboWZrdjHrmDe3-AsHd5pG3D3259QLm1BCVC0s7eeiSrlSdOsgiOTd7L8qBLdjcrWDhjjbQH2iZb2771KBY_00fA4tome4w3CqbN7OnojqTAF4g81kiaEjo8HLiq8dSyRjp7Qkmiq3T6Fhmybulvkn9U Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: d296608fc23c4667b5173c0f3fe1697e Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:12:49.372591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d296608fc23c4667b5173c0f3fe1697e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: d296608fc23c4667b5173c0f3fe1697e Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-DeleteServersTestJSON-660417526 Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-DeleteServersTestJSON-660417526-project Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 5495217023fc44eab2fa73552db6b3f2 Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-DeleteServersTestJSON-660417526-project Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.374142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '807f959c-521d-49d7-87d0-3a7b22a174a7'} Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:12:49.375018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. Oct 23 02:12:49.376062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:12:49.377020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] Returning 404 to user: Instance 807f959c-521d-49d7-87d0-3a7b22a174a7 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:12:49.377020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-12f4db7a-b0e3-4310-a52c-53699c9ab8d7 tempest-DeleteServersTestJSON-660417526 tempest-DeleteServersTestJSON-660417526-project] 10.222.0.23 "GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7" status: 404 len: 111 microversion: 2.1 time: 0.031037 Oct 23 02:12:49.377020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 103/194] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:49 2022] GET /compute/v2.1/servers/807f959c-521d-49d7-87d0-3a7b22a174a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:12:49.533444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:49.534212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:49.542731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:49.543220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:49.543660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:49.544380 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:49.544877 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:49.545361 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:49.683948 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:49.695565 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-168dbfd3-db2d-4b34-9101-1e3ddb777a1f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.166058 Oct 23 02:12:49.710814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 92/195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:49 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:50.263107 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:50.263720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:50.269743 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:50.270222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:50.270693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:50.271395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:50.272575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:50.273006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:50.545220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:50.553262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5f8eabb3-fb21-43e7-9db9-ccf46eb7f618 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.293988 Oct 23 02:12:50.553930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 104/196] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:50 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:50.718276 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:50.719045 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:50.726324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:50.726961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:50.727532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:50.728401 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:50.728925 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:50.729419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:50.883319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:50.891313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2a66e008-fbda-4bdc-8cff-0e2804a90cfc tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.176947 Oct 23 02:12:50.891938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 93/197] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:50 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:51.577434 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:51.578136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:51.586086 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:51.587218 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:51.588186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:51.590221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:51.591542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:51.592169 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:51.913213 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:51.914998 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:51.917814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:51.927283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:51.928071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:51.928672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:51.929527 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:51.930131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:51.930761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:51.931821 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-afbeb807-d028-4120-8b48-4573e441bf22 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.359044 Oct 23 02:12:51.932720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 105/198] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:51 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:52.108247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:52.116848 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-59401b49-fd64-49c1-9e97-927c3992a977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.206788 Oct 23 02:12:52.117453 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 94/199] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:51 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:52.956318 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:52.957133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:52.959255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:52.965768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:52.966353 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:52.967496 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:52.968410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:52.968977 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:52.969404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:53.139125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:53.139733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:53.146311 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:53.146832 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:53.147436 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:53.148293 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:53.148747 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:53.149156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:53.300227 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:53.313929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-466c9d56-052b-4881-837d-1bf1a0accf17 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.362054 Oct 23 02:12:53.314940 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 106/200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:52 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:53.589614 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:53.593022 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:12:53.597866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ee8db2dd-c9da-47d0-a38a-f47351dea4c4 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1314 microversion: 2.1 time: 0.462595 Oct 23 02:12:53.602489 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 95/201] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:53 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:12:54.338921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:54.340489 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:54.347973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:54.348462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:54.348820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:54.349511 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:54.350633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:54.351414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:54.500061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:54.510070 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c00f67cd-eaa0-4243-94a0-9c5cfd0bc087 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.175606 Oct 23 02:12:54.510792 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 107/202] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:54 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:54.620939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:54.621619 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:54.628485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:54.629051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:54.629545 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:54.630300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:54.631002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:54.631463 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:54.795535 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:54.804838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-eabd0e07-3fba-4652-8ba5-c91b4af85714 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1499 microversion: 2.1 time: 0.187704 Oct 23 02:12:54.805475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 96/203] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:54 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1499 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:55.538033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:55.539684 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:55.547244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:55.547957 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:55.548648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:55.549571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:55.550216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:55.550804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:55.815385 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:55.824541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ffccf7fb-f36a-4acd-9946-f93a5026f205 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.293940 Oct 23 02:12:55.825606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 108/204] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:55 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:56.848394 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:56.849011 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:56.856753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:56.857437 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:56.857874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:56.858657 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:56.859699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:56.859699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:57.050848 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:57.060709 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8eaebb8d-e642-4fc3-aa02-20f82a18e626 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.216149 Oct 23 02:12:57.074973 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 97/205] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:56 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:58.085103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:58.085620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:58.091863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:58.092450 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:58.093028 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:58.094466 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:58.095148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:58.095772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:58.309309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:58.318398 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-04617675-abcb-45e8-8d6e-9f2fa615e359 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.237561 Oct 23 02:12:58.333617 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 109/206] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:58 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:59.265785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6f271664-c694-4b2e-8f5c-104be5fc355e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: .version_select at 0x7f9da310a1f0>, body: {"keypair": {"name": "tempest-keypair-982297247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0cuWP25jp54CaSiEHIC92PH22QK+suClgCFjx6otoo6GsYr5HGIgu4Wo30rMd/bHcNc9kEU1jfv+0Ygn3o4m1FMO197wQ500M+pE3QDzZhBvR1er+dr3NueM1xYiJ1BA=="}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:12:59.282340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-6f271664-c694-4b2e-8f5c-104be5fc355e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:12:59.286627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-6f271664-c694-4b2e-8f5c-104be5fc355e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for user 66975cf6d8fa417e8df429d4c89ef910 and project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:12:59.314928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6f271664-c694-4b2e-8f5c-104be5fc355e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172179 Oct 23 02:12:59.318618 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 98/207] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:12:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:12:59.341276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:59.342038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:59.351567 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:59.353514 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:59.358907 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:59.359713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:59.360346 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:59.360942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:59.598601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:12:59.609099 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-994e80b7-e00b-4386-bbc9-20ad26f491b0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.271616 Oct 23 02:12:59.611020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 110/208] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:59 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:12:59.762370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:59.763014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:59.769993 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:59.770801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:59.772060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:59.773179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:59.773648 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:59.774082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:59.802737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:12:59.929773 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8875c83e-316c-4f90-b781-dd42aaa1e6ba tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 204 len: 0 microversion: 2.1 time: 0.170208 Oct 23 02:12:59.930721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 99/209] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:12:59 2022] DELETE /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:12:59.939201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:12:59.940065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:12:59.946704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:59.947278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:59.947953 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:12:59.948844 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:12:59.949358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:12:59.949856 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.154301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:00.166337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b0dcac91-d52a-492f-99b3-ed03dfc40853 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.230797 Oct 23 02:13:00.166959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 111/210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:12:59 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:00.635098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:00.635752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:00.643137 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:00.643865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:00.644375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.645156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:00.645719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:00.646819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:00.888435 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:00.899897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-22b4ad13-32de-41f2-be7c-3c29e0ea7bee tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.270010 Oct 23 02:13:00.900706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 100/211] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:00 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:00.957664 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1331087547", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7b3cf49-41ec-4949-b12a-aff94c1d3d94"}], "security_groups": [{"name": "tempest-securitygroup--847334592"}], "key_name": "tempest-keypair-982297247", "user_data": "}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:01.066036 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] validate_networks() for [('a7b3cf49-41ec-4949-b12a-aff94c1d3d94', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:13:01.193784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:01.194406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:01.201067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:01.201755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:01.202391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:01.203316 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:01.203940 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:01.204371 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:01.407891 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:01.417505 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-eb1443a3-d873-461c-a414-eb717468d13a tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.228006 Oct 23 02:13:01.418315 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 101/212] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:01 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:01.535590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:13:01.536359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:13:01.537356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:13:01.537756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:13:01.538191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:13:01.548711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:01.549201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:01.549634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:01.550402 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:01.551213 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:01.551329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:01.570263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:13:01.574315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for user 66975cf6d8fa417e8df429d4c89ef910 and project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:13:01.585872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:13:01.588227 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:13:01.639302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-96560c6d-2696-499e-bdeb-eded11953ab4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.686022 Oct 23 02:13:01.640043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 112/213] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:13:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:13:01.652068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-61f1d044-9804-43e0-814c-6787eb06b56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:01.653252 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-61f1d044-9804-43e0-814c-6787eb06b56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:01.719299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-61f1d044-9804-43e0-814c-6787eb06b56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:01.728673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-61f1d044-9804-43e0-814c-6787eb06b56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1241 microversion: 2.1 time: 0.080203 Oct 23 02:13:01.729350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 102/214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:01 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:01.924558 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:01.925463 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:01.934334 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:01.934954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:01.935853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:01.936918 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:01.937980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:01.938505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:02.104438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:02.116802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8a0a9542-c6ea-43c2-b8fd-d9da9e6479cd tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.196348 Oct 23 02:13:02.119073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 113/215] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:01 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:02.445389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:02.446012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:02.453099 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:02.453699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:02.454201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:02.455016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:02.455551 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:02.456088 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:02.596989 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:02.605749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cbcad69c-106a-4574-a165-6a964f13404d tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.168294 Oct 23 02:13:02.606336 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 103/216] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:02 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:02.751635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:02.752364 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:02.759224 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:02.759763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:02.760246 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:02.761058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:02.761533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:02.762049 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:02.829348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:02.837985 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5473f9b6-5972-4943-81d3-9fd79c16a6cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1245 microversion: 2.1 time: 0.090298 Oct 23 02:13:02.838684 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 114/217] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:02 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:03.144843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:03.145446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:03.153237 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.153701 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.154133 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.154836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.155314 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.155747 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.283862 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:03.292434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-041a48f6-adc6-4974-93db-34fa751c12d0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.151442 Oct 23 02:13:03.292930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 104/218] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:03 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:03.629954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:03.631387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:03.637501 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.638122 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.638679 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.639421 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.639894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.640314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.779072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:03.781223 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:03.788091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4959dd38-7024-4940-999e-52bfac831cfb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.162001 Oct 23 02:13:03.788651 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 115/219] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:03 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:03.860666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:03.861277 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:03.867360 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.867847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.868288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.868981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:03.869437 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:03.869865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:03.929548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:03.937039 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cffda75d-08be-4f16-b951-9347acd56859 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1245 microversion: 2.1 time: 0.080251 Oct 23 02:13:03.937669 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 105/220] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:03 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:04.316627 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:04.317290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:04.323601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.324124 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.324585 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.325335 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.325830 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.326270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.452309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:04.460103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f33050b9-4789-43f1-8a1c-fb6537113063 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.147596 Oct 23 02:13:04.460656 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 116/221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:04 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:04.811333 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:04.811868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:04.818981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.819460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.819897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.820582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.821035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.821459 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.950185 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:04.957817 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-04126448-d11b-4550-ad8e-42c3ad8edbaf tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.150363 Oct 23 02:13:04.959118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 106/222] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:04 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:04.961124 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:04.961735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:04.967566 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.968042 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.968467 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:04.969145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:04.969585 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:04.970001 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:05.030084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:05.038041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e5d3e78f-76e4-4b29-a48c-531e6189f3bc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1245 microversion: 2.1 time: 0.081445 Oct 23 02:13:05.038624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 117/223] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:04 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:05.482918 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:05.483533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:05.489965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:05.490471 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:05.490918 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:05.491613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:05.492070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:05.492501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:05.621087 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:05.628920 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d858697d-e136-4d85-9db9-df6ab1222eb1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.149910 Oct 23 02:13:05.629478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 107/224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:05 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:05.980952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:05.981565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:05.987518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:05.988001 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:05.988439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:05.989164 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:05.990425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:05.990772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:06.060999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:06.061657 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:06.068873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:06.069382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:06.069824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:06.070646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:06.071103 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:06.071532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:06.146074 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:06.150316 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:06.153801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7a1f3e1c-07e9-4fc1-86a2-83bb8ee07a90 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1245 microversion: 2.1 time: 0.096745 Oct 23 02:13:06.154405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 108/225] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:06 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:06.157973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3dfe34d1-82eb-442f-b62b-3a5ae0c25402 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.180856 Oct 23 02:13:06.158699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 118/226] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:05 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:06.652520 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:06.653153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:06.659064 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:06.659546 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:06.659976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:06.660656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:06.661250 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:06.661791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:06.790613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:06.798402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-079c366e-5f70-4288-9230-e0cacb2ac8c9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.149760 Oct 23 02:13:06.798990 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 109/227] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:06 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:07.177203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:07.177764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:07.182726 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:07.183340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:07.183803 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:07.184309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:07.184738 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:07.185418 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:07.185864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:07.186283 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:07.189647 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:07.190129 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:07.190600 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:07.191290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:07.191746 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:07.192260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:07.253139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:07.261676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c5d50ae3-88da-444f-8115-2b54d44da599 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1245 microversion: 2.1 time: 0.088395 Oct 23 02:13:07.262244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 119/228] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:07 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:07.337417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:07.345440 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ff4b772a-02b9-455f-ba7b-f96461fcab0c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.166439 Oct 23 02:13:07.345997 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 110/229] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:07 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:07.821274 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:07.821909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:07.827920 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:07.828397 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:07.828836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:07.829509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:07.829959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:07.830378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:07.960842 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:07.968636 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-deb5f54e-7c73-4698-ad4e-6b32168f5fb6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.151539 Oct 23 02:13:07.969454 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 120/230] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:07 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:08.285945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:08.286515 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:08.292956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:08.293444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:08.293883 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:08.294861 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:08.295315 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:08.295738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:08.357062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:08.364738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7e1f4ee6-7cff-4c95-a8bc-9ae3bdbb7dca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1245 microversion: 2.1 time: 0.082727 Oct 23 02:13:08.365336 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 111/231] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:08 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:08.368745 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:08.369378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:08.377329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:08.377936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:08.378616 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:08.380093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:08.381329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:08.381775 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:08.511472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:08.519109 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-61dee4f1-7edf-43f2-a65b-c5ecc72309ef tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.154343 Oct 23 02:13:08.519675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 121/232] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:08 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:08.993807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:08.994421 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:09.000410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.000900 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.001342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.002034 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.002519 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.002949 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.136756 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:09.140451 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:09.146723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4e19acbe-59d2-4f83-8e02-ece16b03f30e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.157472 Oct 23 02:13:09.147384 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 112/233] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:08 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:09.388100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:09.388695 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:09.395538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.396079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.396507 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.397205 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.397648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.398061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.459869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:09.468470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e5f163fa-71b3-4448-9af6-bdb056d36b1b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1237 microversion: 2.1 time: 0.084240 Oct 23 02:13:09.469019 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 122/234] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:09 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:09.542750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:09.543291 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:09.554623 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.555475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.556221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.557407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:09.558220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:09.559037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:09.698195 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:09.705874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-84e1c5f5-9379-40ab-8f3f-ab568e340d74 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.167814 Oct 23 02:13:09.706664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 113/235] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:09 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:10.171469 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:10.172063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:10.178709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:10.179196 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:10.180038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:10.180877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:10.181426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:10.181863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:10.317150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:10.326982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-09e37ce5-4fb4-487d-b5ae-ee076358b719 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.159656 Oct 23 02:13:10.327556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 123/236] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:10 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:10.494816 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:10.495695 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:10.502319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:10.502935 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:10.503522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:10.504261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:10.505381 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:10.505872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:10.568359 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:10.576728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-dc215066-ec80-4bbe-80fe-45a1eccbab32 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1301 microversion: 2.1 time: 0.087765 Oct 23 02:13:10.577297 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 114/237] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:10 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:10.729794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:10.730454 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:10.737510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:10.738185 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:10.738837 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:10.739926 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:10.740864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:10.741594 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:11.026526 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:11.035060 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3796395d-2750-4bfc-abdc-bb397d6023fd tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.309133 Oct 23 02:13:11.035777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 124/238] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:10 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:11.349766 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:11.350375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:11.356612 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:11.357094 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:11.357528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:11.358328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:11.358818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:11.359243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:11.496992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:11.504970 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a12a9573-4429-4560-abfa-76e9708d27f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.159820 Oct 23 02:13:11.505554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 115/239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:11 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:11.600347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:11.600976 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:11.602826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:11.603499 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=6 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:11.612003 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:11.612524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:11.612942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:11.613633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:11.614082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:11.614687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:11.677465 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:11.685113 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1aa52974-697c-4636-8bf7-f2136ce45cb6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1311 microversion: 2.1 time: 0.089222 Oct 23 02:13:11.685895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 125/240] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:11 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:12.067660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:12.068169 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:12.071154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=6 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:12.076709 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:12.077792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:12.078686 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:12.079772 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:12.080259 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:12.080706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:12.224962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:12.232782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f9bb3cc0-fd2b-4b24-b496-0008cc2b7425 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1505 microversion: 2.1 time: 0.169040 Oct 23 02:13:12.233388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 116/241] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:12 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:12.528446 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:12.529093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:12.535966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:12.536444 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:12.537021 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:12.537721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:12.538179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:12.538635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:12.712806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:12.713488 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:12.720350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:12.720844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:12.721533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:12.722477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:12.723713 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:12.726341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:13.089782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:13.100385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-115db3d3-efe4-4821-86ec-67bce23d5041 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1299 microversion: 2.1 time: 0.392488 Oct 23 02:13:13.101466 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 117/242] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:12 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1299 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:13.118414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:13.128243 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-32a7b591-a307-447a-823b-a8b0d16db128 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.603801 Oct 23 02:13:13.128831 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 126/243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:12 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:13.257416 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:13.257979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:13.263868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:13.264351 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:13.264854 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:13.265673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:13.266125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:13.266579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:13.367471 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:13.375797 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-dd600c3f-5c0e-44f1-9e62-53475405c72b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1463 microversion: 2.1 time: 0.122864 Oct 23 02:13:13.376616 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 118/244] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:13 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1463 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:13.471080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-5b3f9632-4efe-4a85-8726-5cdfc0060663 req-47149902-2f06-4932-a518-ced598f60c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f2a875f-e253-497b-a316-729833572690", "name": "network-vif-deleted", "tag": "04e7e7de-2c70-4c7e-ac6f-c1a8f4d25e2e"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:13.482997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5b3f9632-4efe-4a85-8726-5cdfc0060663 req-47149902-2f06-4932-a518-ced598f60c11 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:13.483559 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5b3f9632-4efe-4a85-8726-5cdfc0060663 req-47149902-2f06-4932-a518-ced598f60c11 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:13.483899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5b3f9632-4efe-4a85-8726-5cdfc0060663 req-47149902-2f06-4932-a518-ced598f60c11 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:13.497284 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-5b3f9632-4efe-4a85-8726-5cdfc0060663 req-47149902-2f06-4932-a518-ced598f60c11 service nova] Creating event network-vif-deleted:04e7e7de-2c70-4c7e-ac6f-c1a8f4d25e2e for instance 7f2a875f-e253-497b-a316-729833572690 on hv-cinder-86149 Oct 23 02:13:13.502561 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-5b3f9632-4efe-4a85-8726-5cdfc0060663 req-47149902-2f06-4932-a518-ced598f60c11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037658 Oct 23 02:13:13.503381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 127/245] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:14.128194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:14.128808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:14.135403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.135885 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.136318 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.137010 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.137465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.137894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.152745 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:14.153434 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:14.159470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.159891 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.161362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.162254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.162935 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.163535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.494963 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:14.501263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:14.503208 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7653a48d-5ba5-4a73-a65c-068ad1da9ace tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1366 microversion: 2.1 time: 0.378766 Oct 23 02:13:14.504506 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 119/246] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:14 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:14.509541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e9f4e146-5e8e-4188-bb64-e9f6186cb945 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1521 microversion: 2.1 time: 0.361305 Oct 23 02:13:14.510116 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 128/247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:14 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:14.518640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:14.520208 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:14.526726 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.527389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.527985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.528838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.529314 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.529884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.564510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:14.565041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:14.565480 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:14.565991 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lazy-loading 'fault' on Instance uuid 7f2a875f-e253-497b-a316-729833572690 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:13:14.622952 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:14.631992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-76f20d7b-86f7-46ec-8805-a9510922e977 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 200 len: 1304 microversion: 2.1 time: 0.125961 Oct 23 02:13:14.633473 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 120/248] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:14 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:15.527493 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:15.528740 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:15.534723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-d101a846-7eaa-47e4-852d-1bebc3421527 req-347e2e6a-d928-41ff-9d17-a7c3da504f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89425f0-1391-4e8f-9135-b292f96bbb8f", "tag": "3575bee5-b894-41b6-ba5e-2cac0d91950d"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:15.535163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.536397 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.536895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.537649 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.538168 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.538687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.548887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-d101a846-7eaa-47e4-852d-1bebc3421527 req-347e2e6a-d928-41ff-9d17-a7c3da504f22 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.549361 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-d101a846-7eaa-47e4-852d-1bebc3421527 req-347e2e6a-d928-41ff-9d17-a7c3da504f22 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.549819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-d101a846-7eaa-47e4-852d-1bebc3421527 req-347e2e6a-d928-41ff-9d17-a7c3da504f22 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.564074 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-d101a846-7eaa-47e4-852d-1bebc3421527 req-347e2e6a-d928-41ff-9d17-a7c3da504f22 service nova] Creating event network-changed:3575bee5-b894-41b6-ba5e-2cac0d91950d for instance d89425f0-1391-4e8f-9135-b292f96bbb8f on hv-cinder-86149 Oct 23 02:13:15.569910 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-d101a846-7eaa-47e4-852d-1bebc3421527 req-347e2e6a-d928-41ff-9d17-a7c3da504f22 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040203 Oct 23 02:13:15.570997 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 121/249] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:15.577155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:15.577711 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:15.584867 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.585363 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.585808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.586606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.587065 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.587495 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.792217 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:15.803917 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-aeb1bfe9-3fe9-47ba-8b26-d7efd6161e9d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1366 microversion: 2.1 time: 0.280285 Oct 23 02:13:15.804945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 129/250] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:15 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:15.813351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:15.814596 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: 7f2a875f-e253-497b-a316-729833572690] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:15.834061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.835021 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.835801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.837071 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.837848 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.838625 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.865150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] HTTP exception thrown: Instance 7f2a875f-e253-497b-a316-729833572690 could not be found. Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Request method failure captured: Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 HTTP/1.1 Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKMGaCD0lYQwFjtKuSUZB7S1wQ9zVsgU850TW3oo8e5WhyAv5VGT6QJ-EB18xGOSe_J6K_VRcXXSLPKd0iIyH3pQ-YuTcthXzPNBY_jwQ05rT7OLeNu7GP5IaEKi4ULCdqBnsAwwPa9iD8QyeMCLwTtaxZnxGl5O73SYR0c4KecveHk Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: e84f012d59214a6bb6e7f5490bfb2bfc Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesActionsTest-1962269863 Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:13:15.868513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e84f012d59214a6bb6e7f5490bfb2bfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e84f012d59214a6bb6e7f5490bfb2bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e84f012d59214a6bb6e7f5490bfb2bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e84f012d59214a6bb6e7f5490bfb2bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesActionsTest-1962269863 Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: e84f012d59214a6bb6e7f5490bfb2bfc Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesActionsTest-1962269863 Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesActionsTest-1962269863-project Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 04ee886aeea740428a58a513600fc9b8 Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesActionsTest-1962269863-project Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 7f2a875f-e253-497b-a316-729833572690 could not be found. Oct 23 02:13:15.870027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '7f2a875f-e253-497b-a316-729833572690'} Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f2a875f-e253-497b-a316-729833572690 could not be found. Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:13:15.871141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f2a875f-e253-497b-a316-729833572690 could not be found. Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f2a875f-e253-497b-a316-729833572690 could not be found. Oct 23 02:13:15.872293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:15.873325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Returning 404 to user: Instance 7f2a875f-e253-497b-a316-729833572690 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:13:15.873325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-913c3672-25ec-484b-bd1b-9f990b0d1f25 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690" status: 404 len: 111 microversion: 2.1 time: 0.064331 Oct 23 02:13:15.873325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 130/251] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:15 2022] GET /compute/v2.1/servers/7f2a875f-e253-497b-a316-729833572690 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:13:15.892131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:15.906930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-17fe3a39-6a91-4e40-a92d-5a46dc721ae3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1501 microversion: 2.1 time: 0.334358 Oct 23 02:13:15.907640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 122/252] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:15 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:15.930102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:15.930761 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:15.937686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.938730 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.939164 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:15.939860 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:15.940344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:15.940847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:16.002787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-501389934", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "networks": [{"uuid": "4d27eda4-500e-483b-bb5d-00efa68e057f"}]}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:16.089037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] validate_networks() for [('4d27eda4-500e-483b-bb5d-00efa68e057f', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:13:16.256130 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:16.266096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-42209a87-bdd8-4c99-9975-51e7f20d8523 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1517 microversion: 2.1 time: 0.339795 Oct 23 02:13:16.267073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 131/253] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:15 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1517 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:16.732137 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:13:16.732656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:13:16.733027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:13:16.733792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:13:16.734213 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:13:16.744865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:16.745350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:16.745784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:16.746554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:16.747013 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:16.747465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:16.764319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Getting quotas for project e84f012d59214a6bb6e7f5490bfb2bfc. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:13:16.768149 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Getting quotas for user 04ee886aeea740428a58a513600fc9b8 and project e84f012d59214a6bb6e7f5490bfb2bfc. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:13:16.777577 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:16.781671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:13:16.784014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:13:16.831453 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:16.832356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:16.832911 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9793e4db-d797-499d-af20-dc790efaaac1 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833574 Oct 23 02:13:16.838592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 123/254] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:13:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:13:16.839021 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:16.839749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:16.840457 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:16.841369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:16.842012 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:16.843195 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:16.845720 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bcf213c6-c6ee-4c99-9c21-4b4b4d3f04b8 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:16.848542 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bcf213c6-c6ee-4c99-9c21-4b4b4d3f04b8 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:16.928133 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bcf213c6-c6ee-4c99-9c21-4b4b4d3f04b8 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:16.937647 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bcf213c6-c6ee-4c99-9c21-4b4b4d3f04b8 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1213 microversion: 2.1 time: 0.096817 Oct 23 02:13:16.938707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 124/255] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:16 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:17.025477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:17.045435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-138126c8-5c60-430f-bf93-c8db083e015c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1366 microversion: 2.1 time: 0.220287 Oct 23 02:13:17.046092 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 132/256] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:16 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:17.744964 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:17.747402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:17.754567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:17.755218 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:17.755662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:17.756368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:17.756828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:17.757264 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:17.781531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lazy-loading 'flavor' on Instance uuid afd282d6-75f6-4241-8c5b-d364c031db43 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:13:17.900688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4e2591fc-6847-45af-b50a-5108858b47f7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43/action" status: 200 len: 32 microversion: 2.1 time: 0.160226 Oct 23 02:13:17.902281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 125/257] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:13:17 2022] POST /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:13:17.911733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:17.912348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:17.925265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:17.926147 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:17.926885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:17.927894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:17.928667 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:17.929476 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:17.962899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:17.963678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:17.969860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:17.970901 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:17.971550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:17.972788 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:17.974004 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:17.974786 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:18.116782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:18.128765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-42715744-a6b9-4935-9ecf-3bba7220c477 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1217 microversion: 2.1 time: 0.170573 Oct 23 02:13:18.145231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 126/258] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:17 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:18.150843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:18.151647 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:18.164274 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:18.164274 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:18.164274 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:18.165099 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:18.165630 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:18.166162 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:18.177627 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:18.180489 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:18.189580 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9131e148-c2f2-487a-8d09-1aa37aefd0c3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.282314 Oct 23 02:13:18.190527 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 133/259] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:17 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:18.323287 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:18.331554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-35ae1a05-2ede-469c-a426-150f71b61342 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1366 microversion: 2.1 time: 0.184854 Oct 23 02:13:18.332723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 127/260] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:18 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:19.153790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:19.155047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:19.162194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:19.162851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:19.163504 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:19.164172 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:19.164721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:19.165235 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:19.222257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:19.225728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:19.242738 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:19.249812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:19.251448 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:19.254586 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:19.257576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-10d557e1-8816-4ae3-8724-e17a02b6c41c tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1217 microversion: 2.1 time: 0.106710 Oct 23 02:13:19.259210 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:19.259828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 134/261] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:19 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:19.263849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:19.264850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:19.355189 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:19.355938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:19.376595 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:19.396428 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:19.396961 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:19.397804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:19.402041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:19.411885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:19.997255 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:20.007646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8fe7e4c3-2282-49a8-b3bd-49362548908b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.795276 Oct 23 02:13:20.008839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 128/262] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:19 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:20.024074 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:20.032754 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-65644073-334d-408e-93d0-577a4d34660c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1366 microversion: 2.1 time: 0.681933 Oct 23 02:13:20.033327 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 135/263] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:19 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1366 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:20.293512 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:20.294179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:20.307787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:20.310169 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:20.310945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:20.312506 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:20.313152 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:20.313731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:20.364848 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:20.769801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:20.778299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-42d0cb8d-2f72-4c25-9d30-0469dc71823b tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1265 microversion: 2.1 time: 0.489951 Oct 23 02:13:20.795508 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 129/264] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:20 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1265 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:21.036683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:21.038780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:21.046466 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:21.047218 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:21.047997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:21.048888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:21.049527 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:21.050725 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:21.058217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:21.059003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:21.068150 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:21.069490 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:21.070011 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:21.074991 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:21.075572 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:21.076106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:21.625623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:21.636136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-de6aaac6-35aa-4685-9f82-f90c6c29e7e8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.607351 Oct 23 02:13:21.651790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 136/265] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:21 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:21.712874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:21.725335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d6e164d5-af55-43c7-8028-465b7bab3619 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1366 microversion: 2.1 time: 0.672537 Oct 23 02:13:21.726003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 130/266] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:21 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1366 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:21.806357 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:21.814939 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:21.837550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:21.839268 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:21.839715 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:21.840512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:21.842864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:21.846345 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:21.975230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:22.002583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2a941168-cb51-4ba6-80af-5fa3123ae7d3 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1271 microversion: 2.1 time: 0.199300 Oct 23 02:13:22.006732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 137/267] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:21 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:22.497742 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-78fa79fe-672e-41f6-a034-3eba5544baf7 req-02a968c3-fdaf-4a9f-95df-20305fb9258d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89425f0-1391-4e8f-9135-b292f96bbb8f", "name": "network-vif-plugged", "status": "completed", "tag": "3575bee5-b894-41b6-ba5e-2cac0d91950d"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:22.518344 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-78fa79fe-672e-41f6-a034-3eba5544baf7 req-02a968c3-fdaf-4a9f-95df-20305fb9258d service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:22.520843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-78fa79fe-672e-41f6-a034-3eba5544baf7 req-02a968c3-fdaf-4a9f-95df-20305fb9258d service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:22.521504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-78fa79fe-672e-41f6-a034-3eba5544baf7 req-02a968c3-fdaf-4a9f-95df-20305fb9258d service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:22.533655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-78fa79fe-672e-41f6-a034-3eba5544baf7 req-02a968c3-fdaf-4a9f-95df-20305fb9258d service nova] Creating event network-vif-plugged:3575bee5-b894-41b6-ba5e-2cac0d91950d for instance d89425f0-1391-4e8f-9135-b292f96bbb8f on hv-cinder-86149 Oct 23 02:13:22.539492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-78fa79fe-672e-41f6-a034-3eba5544baf7 req-02a968c3-fdaf-4a9f-95df-20305fb9258d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045632 Oct 23 02:13:22.540091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 131/268] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:22.661725 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:22.662340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:22.671442 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:22.671932 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:22.672368 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:22.673069 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:22.673519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:22.673954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:22.754300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:22.755083 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:22.774690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:22.775295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:22.775733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:22.777888 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:22.778523 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:22.779661 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:23.193912 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:23.204251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e2d4c1d8-7150-49b0-a2a1-779a7b16b9e3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.546644 Oct 23 02:13:23.205365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 138/269] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:22 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:23.215175 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:23.216112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:23.223287 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:23.225414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:23.225816 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:23.230063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:23.231359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:23.231973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:23.232553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:23.387986 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:23.407019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-37bb19d4-d7c6-4808-9963-9667c4f2a673 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1366 microversion: 2.1 time: 0.654857 Oct 23 02:13:23.407663 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 132/270] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:22 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1366 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:23.674376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:23.701438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cdec96d3-c81a-4458-a5f5-c6517303ce42 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.492697 Oct 23 02:13:23.724791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 139/271] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:23 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:24.232356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:24.232971 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:24.245710 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:24.246222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:24.246801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:24.251765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:24.252361 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:24.253544 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:24.430548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:24.431476 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:24.438164 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:24.438845 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:24.439304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:24.440171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:24.441202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:24.441908 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:24.665731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:24.704338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8bbe8644-2049-43ba-8cd5-293ab11148f2 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.479465 Oct 23 02:13:24.707557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 133/272] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:24 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:24.720840 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-fe959133-8ee8-42ed-bdbd-c6b77d3cd15d req-5d602cb7-15f3-4306-adc6-c91fb8a0d918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3", "tag": "61317ede-51a1-40af-8eb5-20b778437720"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:24.761939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-fe959133-8ee8-42ed-bdbd-c6b77d3cd15d req-5d602cb7-15f3-4306-adc6-c91fb8a0d918 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:24.762653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-fe959133-8ee8-42ed-bdbd-c6b77d3cd15d req-5d602cb7-15f3-4306-adc6-c91fb8a0d918 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:24.763101 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-fe959133-8ee8-42ed-bdbd-c6b77d3cd15d req-5d602cb7-15f3-4306-adc6-c91fb8a0d918 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:24.786145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-fe959133-8ee8-42ed-bdbd-c6b77d3cd15d req-5d602cb7-15f3-4306-adc6-c91fb8a0d918 service nova] Creating event network-changed:61317ede-51a1-40af-8eb5-20b778437720 for instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 on hv-cinder-86149 Oct 23 02:13:24.803707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-fe959133-8ee8-42ed-bdbd-c6b77d3cd15d req-5d602cb7-15f3-4306-adc6-c91fb8a0d918 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087654 Oct 23 02:13:24.805410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 134/273] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:24.812212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:24.813571 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:24.825500 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:24.828226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:24.828877 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:24.829803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:24.832852 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:24.834354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:24.854197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:24.865035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7879f3a1-cda6-495b-bf98-4460219afc46 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1366 microversion: 2.1 time: 0.435759 Oct 23 02:13:24.867982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 140/274] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:24 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:25.102891 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:25.111829 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-33510843-d530-48bb-acca-1e2687930158 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.305020 Oct 23 02:13:25.114013 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 135/275] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:24 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:25.738200 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:25.739133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:25.745782 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:25.746388 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:25.747392 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:25.749460 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:25.751033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:25.751625 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:25.893069 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:25.896428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:25.929089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:25.929588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:25.931186 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:25.932229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:25.932915 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:25.935108 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:26.225493 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:26.239157 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-faf5590a-ffe2-4f9d-b465-39e6742b411b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.512641 Oct 23 02:13:26.241273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 141/276] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:25 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:26.246895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:26.248032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:26.256202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:26.256932 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:26.257706 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:26.259201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:26.259877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:26.260562 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:26.380161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:26.391774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e03df7c7-906e-4419-8eb8-6b3fad36db13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1556 microversion: 2.1 time: 0.503095 Oct 23 02:13:26.394607 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 136/277] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:25 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1556 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:26.415196 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:26.415471 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:26.422593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:26.423281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:26.424465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:26.425508 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:26.426159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:26.426804 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:26.581826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:26.598346 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5c7af9f9-2267-49db-93f3-ec6ce22d9e92 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.353410 Oct 23 02:13:26.599345 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 142/278] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:26 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:26.635279 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4a33e1d1-c29b-464d-a468-9b75ffc6cb26 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.224007 Oct 23 02:13:26.636032 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 137/279] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 23 02:13:26 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:13:27.269218 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:27.269923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:27.283073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:27.283566 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:27.284542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:27.285625 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:27.286079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:27.286526 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:27.622586 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:27.625892 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:27.631123 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:27.637719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=8 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:27.652676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:27.664448 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:27.665213 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:27.667526 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:27.668648 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:27.671400 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:27.837879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:27.852511 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e84a02d9-41f0-4e8c-b6a8-232c7f5e120b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.588228 Oct 23 02:13:27.853444 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 143/280] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:27 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:27.978487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:27.986467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-acfd750d-e0d9-4456-a3ad-5ba745edd3bb tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.368411 Oct 23 02:13:27.992821 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 138/281] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:27 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:28.666547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-d0ff4b00-f097-46f5-ae4c-68d6e031ba80 req-4d7fd9fe-e427-4e5b-b2ce-f1330d43ff08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89425f0-1391-4e8f-9135-b292f96bbb8f", "tag": "3575bee5-b894-41b6-ba5e-2cac0d91950d"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:28.683457 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d0ff4b00-f097-46f5-ae4c-68d6e031ba80 req-4d7fd9fe-e427-4e5b-b2ce-f1330d43ff08 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:28.687048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d0ff4b00-f097-46f5-ae4c-68d6e031ba80 req-4d7fd9fe-e427-4e5b-b2ce-f1330d43ff08 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:28.693728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d0ff4b00-f097-46f5-ae4c-68d6e031ba80 req-4d7fd9fe-e427-4e5b-b2ce-f1330d43ff08 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:28.713321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-d0ff4b00-f097-46f5-ae4c-68d6e031ba80 req-4d7fd9fe-e427-4e5b-b2ce-f1330d43ff08 service nova] Creating event network-changed:3575bee5-b894-41b6-ba5e-2cac0d91950d for instance d89425f0-1391-4e8f-9135-b292f96bbb8f on hv-cinder-86149 Oct 23 02:13:28.720518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-d0ff4b00-f097-46f5-ae4c-68d6e031ba80 req-4d7fd9fe-e427-4e5b-b2ce-f1330d43ff08 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057588 Oct 23 02:13:28.721435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 144/282] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:28.885734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:28.886479 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:28.898865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:28.899462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:28.902282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:28.903113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:28.903655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:28.904362 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:29.021555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:29.023044 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:29.029964 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:29.031277 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:29.031885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:29.035623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:29.036280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:29.038261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:29.203667 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:29.217291 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-950ae339-7adf-446d-9439-b825fd8caceb tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.340019 Oct 23 02:13:29.217895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 139/283] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:28 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:29.300020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:29.317276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e4885264-2094-4ff9-b294-71b749774c35 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.305043 Oct 23 02:13:29.317961 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 145/284] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:29 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:29.543597 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4cf8b280-4810-4471-80f7-e328d7ea8d42 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Action: 'create', calling method: .version_select at 0x7f9da3bf9dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1022248569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYWsefa2PRtEmTLo0i1IlcymbGdwi6Og/rhHm8XCU55lrClukFVqJY9GT8Xb6Hpq+iZZmfRzIQ7zKKM2/j0Y2Hmp6HBY8TcixEt4SE2IzVSb0bLr+e3OyQzeZUqbkXjWg=="}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:29.560548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-4cf8b280-4810-4471-80f7-e328d7ea8d42 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Getting quotas for project 10f27676e78f475fa9734f3d6f541da5. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:13:29.566116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-4cf8b280-4810-4471-80f7-e328d7ea8d42 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Getting quotas for user d8cd3210dbea46d6912c93c6d28356ae and project 10f27676e78f475fa9734f3d6f541da5. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:13:29.612886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4cf8b280-4810-4471-80f7-e328d7ea8d42 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.300762 Oct 23 02:13:29.620334 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 140/285] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:13:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:13:30.242156 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:30.245243 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:30.257921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:30.258413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:30.258870 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:30.260931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:30.261550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:30.263735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:30.341299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:30.341991 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:30.356662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:30.365276 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:30.365920 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:30.367985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:30.368683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:30.369302 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:30.675660 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:30.683803 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4c6a267e-499e-4198-997d-dca49568e7c6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.447398 Oct 23 02:13:30.684387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 146/286] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:30 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:30.818801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:30.828032 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-81cf57db-9e4d-475a-9f07-7ef2c30bd390 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.490754 Oct 23 02:13:30.828718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 141/287] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:30 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:31.707532 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:31.708141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:31.715233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:31.716028 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:31.716760 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:31.717670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:31.718336 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:31.719138 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:31.854077 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:31.854808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:31.861453 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:31.862319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:31.862856 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:31.863650 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:31.864345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:31.864994 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:31.867965 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:31.876151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-20355872-0c7b-4e7f-b1bc-6c2668cc43d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.173392 Oct 23 02:13:31.876714 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 147/288] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:31 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:32.000477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:32.008671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-303adb10-8342-44de-af38-ce873fdf09e2 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.158993 Oct 23 02:13:32.009240 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 142/289] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:31 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:32.888188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-f46a3634-b6b9-4c72-b8d1-ec268c2c289a req-8205e858-b4bd-4aa3-acc1-8c384b27af27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3", "name": "network-vif-plugged", "status": "completed", "tag": "61317ede-51a1-40af-8eb5-20b778437720"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:32.900396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:32.901092 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:32.913428 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f46a3634-b6b9-4c72-b8d1-ec268c2c289a req-8205e858-b4bd-4aa3-acc1-8c384b27af27 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:32.915282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:32.915897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f46a3634-b6b9-4c72-b8d1-ec268c2c289a req-8205e858-b4bd-4aa3-acc1-8c384b27af27 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:32.916447 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:32.916945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f46a3634-b6b9-4c72-b8d1-ec268c2c289a req-8205e858-b4bd-4aa3-acc1-8c384b27af27 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:32.918194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:32.921823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:32.922388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:32.923373 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:32.934351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-f46a3634-b6b9-4c72-b8d1-ec268c2c289a req-8205e858-b4bd-4aa3-acc1-8c384b27af27 service nova] Creating event network-vif-plugged:61317ede-51a1-40af-8eb5-20b778437720 for instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 on hv-cinder-86149 Oct 23 02:13:32.945352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-f46a3634-b6b9-4c72-b8d1-ec268c2c289a req-8205e858-b4bd-4aa3-acc1-8c384b27af27 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061115 Oct 23 02:13:32.946183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 148/290] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:33.033451 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:33.034254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:33.040688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:33.041171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:33.041687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:33.044341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:33.044838 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:33.045258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:33.068575 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:33.077415 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-82508739-eae7-4e8d-afb8-9a403ee96b7f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.181365 Oct 23 02:13:33.078368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 143/291] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:32 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:33.187780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:33.209936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7f35db7d-a610-4e03-aa48-3e3b62428d66 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.180691 Oct 23 02:13:33.214627 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 149/292] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:33 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:34.101342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:34.101955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:34.108251 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:34.108733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:34.109186 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:34.109859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:34.110315 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:34.110764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:34.234327 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:34.236135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:34.239247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:34.243443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:34.243947 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:34.244547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:34.245236 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:34.246153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:34.246760 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:34.248961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-47d8159a-e021-4f3e-a5b1-679e95a3a5a1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.151433 Oct 23 02:13:34.249557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 144/293] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:34 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:34.410606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:34.418932 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7869fee2-c788-4641-a14c-79efdf939493 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.189650 Oct 23 02:13:34.419518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 150/294] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:34 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:35.274161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:35.274940 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:35.282427 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:35.283288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:35.284155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:35.284549 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:35.285005 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:35.285430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:35.424028 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:35.431708 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9a1703e1-5cdb-4c6e-9ace-cef1239dce71 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.162215 Oct 23 02:13:35.432362 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 145/295] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:35 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:35.442599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:35.443947 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:35.450064 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:35.450670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:35.451192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:35.451953 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:35.452472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:35.452972 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:35.596972 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:35.599880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:35.606688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f032a391-9266-4e36-8d46-ff9c7e23b988 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1313 microversion: 2.1 time: 0.168942 Oct 23 02:13:35.607255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 151/296] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:35 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:36.458216 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:36.458844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:36.465116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:36.465594 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:36.466023 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:36.466737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:36.467233 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:36.467653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:36.604270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:36.611795 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1fcfc659-9268-4c5c-bfd8-f08fdd63a74a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.158073 Oct 23 02:13:36.612355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 146/297] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:36 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:36.629625 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:36.630343 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:36.636673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:36.637152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:36.637608 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:36.638273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:36.638751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:36.639174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:36.770053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:36.777644 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c9660d25-fd2a-4156-b6bd-7df410b09e30 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1497 microversion: 2.1 time: 0.152235 Oct 23 02:13:36.778400 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 152/298] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:36 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:37.596702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:37.597304 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:37.603579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.604059 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.604491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.605176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.605621 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.606037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.630549 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:13:37.634589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:37.635135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:37.641369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.641851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.642880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.643579 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.644033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.644457 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.666803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:37.714585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-db47740f-1cfa-4f76-b867-d7690edb29aa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 204 len: 0 microversion: 2.1 time: 0.122004 Oct 23 02:13:37.715270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 147/299] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:13:37 2022] DELETE /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:13:37.724620 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:37.725312 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:37.731256 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.731743 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.732176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.732871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.733321 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.733745 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.797313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:37.806951 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2d3d11ec-a725-4c85-902b-b47170dbd177 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1503 microversion: 2.1 time: 0.176203 Oct 23 02:13:37.807689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 153/300] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:37 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:37.835180 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39476b11-2afd-4a58-9f16-063f660610ad"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:37.837509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:37.843893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.844571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.845101 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.846051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.846743 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.847352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.872717 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] HTTP exception thrown: Cannot 'attach_volume' instance afd282d6-75f6-4241-8c5b-d364c031db43 while it is in vm_state rescued Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Request method failure captured: Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: POST /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43/os-volume_attachments HTTP/1.1 Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 74 Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLTOhI2m3mC7wlIqd4CYp_smt7j-uUYTHtphx3tpP-_pKnVPURgJoWW71reomIvkE2qFOSd-STCx1RUAT7e40Y1Ze6pHTvgD4ydMa-n6L3tJdeVRqrwiep-_GtviydtY9KdggIAflNA-tUJ8-6E384vIlw5sc3c_rNbZyiToR1MqDc Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:13:37.874829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 2335878ea1d045858b158f6b4175e896 Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {"volumeAttachment": {"volumeId": "39476b11-2afd-4a58-9f16-063f660610ad"}} Oct 23 02:13:37.876093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Cannot 'attach_volume' instance afd282d6-75f6-4241-8c5b-d364c031db43 while it is in vm_state rescued Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'server_id': 'afd282d6-75f6-4241-8c5b-d364c031db43', 'body': {'volumeAttachment': {'volumeId': '39476b11-2afd-4a58-9f16-063f660610ad'}}} Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afd282d6-75f6-4241-8c5b-d364c031db43 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:13:37.877609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance afd282d6-75f6-4241-8c5b-d364c031db43 while it is in vm_state rescued Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:37.878744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:37.879766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:13:37.879766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:13:37.879766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance afd282d6-75f6-4241-8c5b-d364c031db43 while it is in vm_state rescued Oct 23 02:13:37.879766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:13:37.879766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Returning 409 to user: Cannot 'attach_volume' instance afd282d6-75f6-4241-8c5b-d364c031db43 while it is in vm_state rescued {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:13:37.879766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0689c7ef-a8c5-42b5-b9aa-9c09e5af4b7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046312 Oct 23 02:13:37.880849 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 154/301] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:13:37 2022] POST /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 23 02:13:37.885624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:37.887189 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:37.893780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.894275 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.894746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.895482 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.895932 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.896351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.904327 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:37.913874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d5e5716a-d9fb-455c-ada3-95da8675900e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1503 microversion: 2.1 time: 0.194124 Oct 23 02:13:37.914557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 148/302] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:37 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:13:37.972232 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-017b6423-499f-453d-b89b-eb58a22f1b99 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43/action" status: 202 len: 0 microversion: 2.1 time: 0.090057 Oct 23 02:13:37.972944 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 155/303] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:13:37 2022] POST /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:13:37.986944 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:37.987756 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:37.995262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.995826 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.996468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:37.997243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:37.997737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:37.998211 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:38.147081 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:38.157656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-47f15d61-a25e-4fa5-9827-f90b0f3b62f1 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1511 microversion: 2.1 time: 0.179739 Oct 23 02:13:38.158866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 149/304] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:37 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:38.937591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:38.938241 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:38.945116 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:38.945597 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:38.946028 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:38.946748 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:38.947197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:38.947619 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:39.079127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:39.086894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b93dbcc0-1de1-4cb9-b670-3ab9122c9dfa tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1503 microversion: 2.1 time: 0.153569 Oct 23 02:13:39.088256 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 156/305] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:38 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:39.182217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:39.182864 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:39.189723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:39.190072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:39.190539 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:39.191242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:39.191702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:39.192128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:39.419464 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:39.428408 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0eb58e31-ff9a-45ee-a4b1-9c4b124d8137 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1511 microversion: 2.1 time: 0.249989 Oct 23 02:13:39.428995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 150/306] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:39 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:40.111888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:40.113492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:40.119497 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:40.119981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:40.120411 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:40.121101 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:40.121553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:40.121977 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:40.400103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:40.408468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6ec5013f-7273-4b9b-83ab-df1653fedf24 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1503 microversion: 2.1 time: 0.300467 Oct 23 02:13:40.409041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 157/307] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:40 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:40.453287 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:40.454242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:40.456488 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=4 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:40.474926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:40.475428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:40.475871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:40.476577 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:40.477036 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:40.477465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:40.707513 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:40.709125 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-5dbb71df-4651-4ead-8c4d-80d94a3eed19 req-23dd8e94-9c3b-422a-9581-80157bec8ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3", "name": "network-vif-deleted", "tag": "61317ede-51a1-40af-8eb5-20b778437720"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:40.720145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5dbb71df-4651-4ead-8c4d-80d94a3eed19 req-23dd8e94-9c3b-422a-9581-80157bec8ea6 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:40.720620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5dbb71df-4651-4ead-8c4d-80d94a3eed19 req-23dd8e94-9c3b-422a-9581-80157bec8ea6 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:40.721040 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5dbb71df-4651-4ead-8c4d-80d94a3eed19 req-23dd8e94-9c3b-422a-9581-80157bec8ea6 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:40.721966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-13e8803a-db3d-458f-ac0f-4a37c01c75d6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1511 microversion: 2.1 time: 0.272473 Oct 23 02:13:40.722574 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 151/308] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:40 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:40.744057 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-5dbb71df-4651-4ead-8c4d-80d94a3eed19 req-23dd8e94-9c3b-422a-9581-80157bec8ea6 service nova] Creating event network-vif-deleted:61317ede-51a1-40af-8eb5-20b778437720 for instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 on hv-cinder-86149 Oct 23 02:13:40.749918 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-5dbb71df-4651-4ead-8c4d-80d94a3eed19 req-23dd8e94-9c3b-422a-9581-80157bec8ea6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048784 Oct 23 02:13:40.750918 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 158/309] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:13:41.432615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:41.433142 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:41.441059 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:41.441573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:41.442017 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:41.442769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:41.443229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:41.443661 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:41.475911 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:41.476551 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:41.476811 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:41.477249 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lazy-loading 'fault' on Instance uuid b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:13:41.521379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:41.529026 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e3901c5e-1ea7-4814-8d91-8b93f0812b19 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1303 microversion: 2.1 time: 0.100416 Oct 23 02:13:41.529595 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 152/310] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:41 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:41.745909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:41.746631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:41.753602 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:41.754083 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:41.754541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:41.755226 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:41.755680 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:41.756102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:41.896771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:41.905156 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b5f7c17f-d813-4b36-9a5f-1d3183dd26a9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1511 microversion: 2.1 time: 0.163652 Oct 23 02:13:41.905712 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 159/311] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:41 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:42.551897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:42.552507 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:42.559069 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:42.559556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:42.559992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:42.560680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:42.561132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:42.561556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:42.594226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:42.594785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:42.595718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:42.596158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lazy-loading 'fault' on Instance uuid b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:13:42.636937 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:42.645071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0b0c943f-41f0-4abe-9e2a-7049788c267e tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1303 microversion: 2.1 time: 0.097574 Oct 23 02:13:42.645608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 153/312] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:42 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:42.928475 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:42.929085 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:42.935210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:42.935697 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:42.936131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:42.936819 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:42.937272 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:42.937694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:43.077005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:43.085645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-41fe95fe-b63d-4a53-a6c1-c3d74fd802a5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1511 microversion: 2.1 time: 0.161099 Oct 23 02:13:43.086288 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 160/313] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:42 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:43.668728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:43.669364 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:43.677461 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:43.677876 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:43.678299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:43.691006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:43.691757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:43.692370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:43.733571 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:43.734062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:43.734518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:43.735139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lazy-loading 'fault' on Instance uuid b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:13:43.779996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ee886aeea740428a58a513600fc9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f012d59214a6bb6e7f5490bfb2bfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:43.788184 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3161f13c-79fa-4484-af4a-7890963af03f tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 200 len: 1303 microversion: 2.1 time: 0.123596 Oct 23 02:13:43.788754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 154/314] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:43 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 1303 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:44.108670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:44.109276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:44.115129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:44.115577 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:44.116005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:44.116688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:44.117212 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:44.117543 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:44.248439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:44.256238 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-82af4295-18c8-4a38-baf5-619edaa27690 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1517 microversion: 2.1 time: 0.151421 Oct 23 02:13:44.256809 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 161/315] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:44 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:44.815397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:44.815979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] [instance: b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:44.823796 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:44.824869 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:44.826203 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:44.827040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:44.827504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:44.828362 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] HTTP exception thrown: Instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 could not be found. Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Request method failure captured: Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 HTTP/1.1 Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMGaCD0lYQwFjtKuSUZB7S1wQ9zVsgU850TW3oo8e5WhyAv5VGT6QJ-EB18xGOSe_J6K_VRcXXSLPKd0iIyH3pQ-YuTcthXzPNBY_jwQ05rT7OLeNu7GP5IaEKi4ULCdqBnsAwwPa9iD8QyeMCLwTtaxZnxGl5O73SYR0c4KecveHk Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: e84f012d59214a6bb6e7f5490bfb2bfc Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-VolumesActionsTest-1962269863 Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:13:44.853749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e84f012d59214a6bb6e7f5490bfb2bfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e84f012d59214a6bb6e7f5490bfb2bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e84f012d59214a6bb6e7f5490bfb2bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e84f012d59214a6bb6e7f5490bfb2bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-VolumesActionsTest-1962269863 Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: e84f012d59214a6bb6e7f5490bfb2bfc Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-VolumesActionsTest-1962269863 Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-VolumesActionsTest-1962269863-project Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 04ee886aeea740428a58a513600fc9b8 Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-VolumesActionsTest-1962269863-project Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 could not be found. Oct 23 02:13:44.855044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3'} Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 could not be found. Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:13:44.855750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 could not be found. Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 could not be found. Oct 23 02:13:44.857159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:13:44.860636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] Returning 404 to user: Instance b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:13:44.860636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ba482db6-4707-4790-88f4-20ac9aaec6b0 tempest-VolumesActionsTest-1962269863 tempest-VolumesActionsTest-1962269863-project] 10.222.0.23 "GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3" status: 404 len: 111 microversion: 2.1 time: 0.041842 Oct 23 02:13:44.860636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 155/316] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:44 2022] GET /compute/v2.1/servers/b7d9fafa-0055-4d69-b8bd-ba9109e2d0f3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:13:46.726425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-42358e55-41c6-4dfb-8423-009f48d9efe3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'create', calling method: .version_select at 0x7f9da3374b80>, body: {"keypair": {"name": "tempest-keypair-297625521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCid2YrgxWn1EBoEeUPJh4WnUecjT2S8IIfRqRs/t4uD0dKbOHNwxUP53cmisuro6NJC9XXwU3bYQkmUfG0XyM3exj1++DwLj2dvBNE6ew2upZJsNlAOzBRsjHwb7JXCgA=="}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:46.746908 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-42358e55-41c6-4dfb-8423-009f48d9efe3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Getting quotas for project d7ac3d840c9f41ea842b8f4935770f8b. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:13:46.751528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-42358e55-41c6-4dfb-8423-009f48d9efe3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Getting quotas for user 2335878ea1d045858b158f6b4175e896 and project d7ac3d840c9f41ea842b8f4935770f8b. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:13:46.788380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-42358e55-41c6-4dfb-8423-009f48d9efe3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065919 Oct 23 02:13:46.788975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 162/317] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:13:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:48.199680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-413367882", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58f026bd-fcaf-462d-9303-e2ae6bbc3a9e"}], "security_groups": [{"name": "tempest-securitygroup--1313551837"}], "key_name": "tempest-keypair-297625521", "user_data": "}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:48.209292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:48.306788 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] validate_networks() for [('58f026bd-fcaf-462d-9303-e2ae6bbc3a9e', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:13:48.692014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:13:48.692622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:13:48.693230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:13:48.693652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:13:48.694076 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:13:48.703116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:48.703643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:48.704337 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:48.705179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:48.705670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:48.706050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:48.723883 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Getting quotas for project d7ac3d840c9f41ea842b8f4935770f8b. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:13:48.727884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Getting quotas for user 2335878ea1d045858b158f6b4175e896 and project d7ac3d840c9f41ea842b8f4935770f8b. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:13:48.739476 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:13:48.741769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:13:48.789410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-45122bc0-032b-4c72-ab06-8137baf93438 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.594049 Oct 23 02:13:48.790055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 156/318] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:13:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:13:48.801956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1d6ccf7f-41a9-4d21-a85a-e11f10d1f3a4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:48.803158 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1d6ccf7f-41a9-4d21-a85a-e11f10d1f3a4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:48.861032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1d6ccf7f-41a9-4d21-a85a-e11f10d1f3a4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:48.869153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1d6ccf7f-41a9-4d21-a85a-e11f10d1f3a4 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1244 microversion: 2.1 time: 0.071673 Oct 23 02:13:48.869748 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 163/319] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:48 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:49.893656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:49.894304 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:49.900302 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:49.900786 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:49.901225 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:49.901914 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:49.902367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:49.902817 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:49.963058 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:49.970761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8f69bf26-bef7-4e7b-bcd2-5867c9a2b781 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1248 microversion: 2.1 time: 0.082060 Oct 23 02:13:49.971323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 157/320] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:49 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:50.993347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:50.993931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:51.002685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:51.003206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:51.003641 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:51.004332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:51.004809 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:51.005234 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:51.064758 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:51.072184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cc5b74da-08ba-4e2e-bead-87367022c0ab tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1248 microversion: 2.1 time: 0.082700 Oct 23 02:13:51.072743 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 164/321] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:50 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:52.095826 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:52.096381 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:52.102569 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:52.103061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:52.103502 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:52.104194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:52.104650 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:52.105076 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:52.167898 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:52.176333 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0f387a65-a775-41ab-a7a0-23c3ae89b872 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1240 microversion: 2.1 time: 0.085456 Oct 23 02:13:52.176909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 158/322] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:52 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:53.199998 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:53.200984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:53.207701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:53.208544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:53.208647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:53.209304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:53.209760 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:53.210186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:53.274296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:53.282280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5680c10e-3e67-44ef-97b5-277674b1ffbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1302 microversion: 2.1 time: 0.086944 Oct 23 02:13:53.282871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 165/323] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:53 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:54.307270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:54.307890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:54.315227 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:54.315708 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:54.316143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:54.316830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:54.317278 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:54.317695 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:54.689288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:54.706239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6be06025-2252-4014-b631-a28fd6f24edc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.402837 Oct 23 02:13:54.707640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 159/324] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:54 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:54.997232 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-a24eebe9-4888-440b-beef-3f87ddd231ee req-65ca1f3b-e75c-4338-a86f-c10d47df6e5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fc5747-8451-4657-979e-570ad7e73b8b", "tag": "91964ab3-6465-4503-be0d-3facc3db73f3"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:13:55.028225 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:55.035925 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a24eebe9-4888-440b-beef-3f87ddd231ee req-65ca1f3b-e75c-4338-a86f-c10d47df6e5c service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:55.056607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a24eebe9-4888-440b-beef-3f87ddd231ee req-65ca1f3b-e75c-4338-a86f-c10d47df6e5c service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:55.058857 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a24eebe9-4888-440b-beef-3f87ddd231ee req-65ca1f3b-e75c-4338-a86f-c10d47df6e5c service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:55.120363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-a24eebe9-4888-440b-beef-3f87ddd231ee req-65ca1f3b-e75c-4338-a86f-c10d47df6e5c service nova] Creating event network-changed:91964ab3-6465-4503-be0d-3facc3db73f3 for instance 91fc5747-8451-4657-979e-570ad7e73b8b on hv-cinder-86149 Oct 23 02:13:55.143850 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-a24eebe9-4888-440b-beef-3f87ddd231ee req-65ca1f3b-e75c-4338-a86f-c10d47df6e5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155049 Oct 23 02:13:55.146280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 166/325] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:13:55.734771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:55.736280 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:55.745118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:55.745930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:55.747107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:55.748622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:55.749868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:55.750520 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:55.939599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:55.952642 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5f409a24-9a47-43d3-9887-3238bda54e05 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.222621 Oct 23 02:13:55.958624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 160/326] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:55 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:56.990700 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:56.992188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:56.999555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:57.000395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:57.001876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:57.002905 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:57.003724 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:57.004145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:57.155798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:57.177074 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e29572ad-e287-45b5-8f4b-ef87885b4185 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.192014 Oct 23 02:13:57.190874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 167/327] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:56 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:58.201971 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:58.203370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:58.211852 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:58.212604 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:58.216838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:58.217830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:58.218305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:58.219062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:58.431974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:58.443672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d82c0707-d10f-498a-a4d1-890f2fb9ca0f tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.244730 Oct 23 02:13:58.447112 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 161/328] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:58 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:13:59.474250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:13:59.475069 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:13:59.481027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=6 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:13:59.482842 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:59.483509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:59.484106 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:59.486170 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:13:59.486802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:13:59.487373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:13:59.656312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:13:59.667295 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e830aa2e-b466-43d1-8b2d-eb8e70c11160 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.198403 Oct 23 02:13:59.667969 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 168/329] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:13:59 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:00.694339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:00.695654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:00.699033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:00.700159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=6 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:00.705781 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:00.706656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:00.707096 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:00.707799 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:00.708254 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:00.708678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:00.860297 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:00.869281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-79743a4d-e295-4398-ac87-f51fb349afae tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.179127 Oct 23 02:14:00.870601 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 162/330] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:00 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:01.894874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:01.895621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:01.902720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:01.903570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:01.904268 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:01.904978 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:01.905480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:01.906166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:02.080978 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:02.094713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0cc6dd15-a520-45ca-93ee-f5f68a1d4340 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.203783 Oct 23 02:14:02.096482 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 169/331] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:01 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:03.120243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:03.121009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:03.129492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:03.130211 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:03.130958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:03.132004 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:03.132703 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:03.133353 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:03.278629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:03.286849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c4e01c3d-ff6d-4aa5-bcce-2946e8c9bf35 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.171123 Oct 23 02:14:03.287419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 163/332] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:03 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:04.263443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-01c6b401-3126-41e9-b239-dc1f07cd5a3f req-96368425-dc5f-4a6e-82d6-33e9e1f98bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fc5747-8451-4657-979e-570ad7e73b8b", "name": "network-vif-plugged", "status": "completed", "tag": "91964ab3-6465-4503-be0d-3facc3db73f3"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:04.286259 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-01c6b401-3126-41e9-b239-dc1f07cd5a3f req-96368425-dc5f-4a6e-82d6-33e9e1f98bed service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:04.287149 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-01c6b401-3126-41e9-b239-dc1f07cd5a3f req-96368425-dc5f-4a6e-82d6-33e9e1f98bed service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:04.288150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-01c6b401-3126-41e9-b239-dc1f07cd5a3f req-96368425-dc5f-4a6e-82d6-33e9e1f98bed service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:04.310650 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:04.311266 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:04.318543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:04.319342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:04.319944 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:04.320835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:04.321435 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:04.322020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:04.326088 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-01c6b401-3126-41e9-b239-dc1f07cd5a3f req-96368425-dc5f-4a6e-82d6-33e9e1f98bed service nova] Creating event network-vif-plugged:91964ab3-6465-4503-be0d-3facc3db73f3 for instance 91fc5747-8451-4657-979e-570ad7e73b8b on hv-cinder-86149 Oct 23 02:14:04.327758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:04.342894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-01c6b401-3126-41e9-b239-dc1f07cd5a3f req-96368425-dc5f-4a6e-82d6-33e9e1f98bed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083956 Oct 23 02:14:04.344354 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 170/333] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:04.539092 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:04.550863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d0032a31-6153-4834-a89c-55d0b5becaf3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.244006 Oct 23 02:14:04.551881 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 164/334] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:04 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:14:05.001840 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-748806503", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1022248569", "security_groups": [{"name": "tempest-secgroup-smoke-301932947"}], "block_device_mapping_v2": [{"uuid": "b0a919e2-97d8-48f0-967d-85145268dee7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c5e8bc1-ae7a-4263-95d0-aa588702beec"}]}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:05.217092 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] validate_networks() for [('6c5e8bc1-ae7a-4263-95d0-aa588702beec', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:14:05.577716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:05.580500 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:05.588673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:05.589550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:05.590395 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:05.591645 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:05.592335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:05.592975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:05.931794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:05.948336 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-792c2ebd-2961-4859-a091-ae89bc57a024 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.376751 Oct 23 02:14:05.952389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 165/335] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:05 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:06.110708 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:14:06.111227 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:14:06.111628 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:14:06.112058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:14:06.112711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:14:06.129266 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:06.129802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:06.130280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:06.131342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:06.133224 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:06.135704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:06.174862 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Getting quotas for project 10f27676e78f475fa9734f3d6f541da5. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:14:06.180290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Getting quotas for user d8cd3210dbea46d6912c93c6d28356ae and project 10f27676e78f475fa9734f3d6f541da5. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:14:06.249260 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:14:06.252331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0a919e2-97d8-48f0-967d-85145268dee7',volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:14:06.423176 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-15132761-56ef-433c-96c2-6049338a4406 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.426072 Oct 23 02:14:06.424486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 171/336] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:14:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:14:06.435966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b7b8e85c-3d01-47c6-ba73-c74c4f99a05d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:06.437105 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b7b8e85c-3d01-47c6-ba73-c74c4f99a05d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:06.517153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b7b8e85c-3d01-47c6-ba73-c74c4f99a05d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:06.525049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b7b8e85c-3d01-47c6-ba73-c74c4f99a05d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1094 microversion: 2.1 time: 0.093269 Oct 23 02:14:06.526066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 166/337] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:06 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:06.984279 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:06.984933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:06.998695 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:07.003036 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:07.004422 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:07.006074 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:07.007612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:07.008651 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:07.021107 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:07.235822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:07.244483 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-30df6256-462b-4911-8984-2528135bed75 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1370 microversion: 2.1 time: 0.270302 Oct 23 02:14:07.245423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 172/338] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:06 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:07.551241 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:07.552596 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:07.560557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:07.561049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:07.561491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:07.562874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:07.563736 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:07.564340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:07.691807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:07.705723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-17bb66dc-d44c-4c76-b14a-dfc1491dc486 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1136 microversion: 2.1 time: 0.159706 Oct 23 02:14:07.707285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 167/339] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:07 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1136 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:08.275621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:08.276318 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:08.296187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:08.296187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:08.296187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:08.296436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:08.296965 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:08.297413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:08.569589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:08.582392 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3f4de746-c90d-40be-b511-9fadeb549bf9 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1564 microversion: 2.1 time: 0.311789 Oct 23 02:14:08.598592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 173/340] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:08 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1564 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:08.609777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:08.610364 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:08.626115 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:08.626919 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:08.627547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:08.628437 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:08.630513 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:08.631145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:08.733139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:08.735758 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:08.753193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:08.753783 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:08.754581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:08.755826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:08.760693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:08.761406 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:08.834079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e615d6c7-a9c3-4694-9c48-1ebd888ccb8c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230318 Oct 23 02:14:08.834904 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 168/341] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 23 02:14:08 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:08.902879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:08.914346 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-73280d7a-b209-489d-8d03-30a8ecb9bb36 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1210 microversion: 2.1 time: 0.184560 Oct 23 02:14:08.916121 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 174/342] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:08 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1210 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:09.940983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:09.941863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:09.956020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:09.956736 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:09.959300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:09.961863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:09.962588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:09.964425 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:10.559466 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:10.568349 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-136afee0-66ee-43f1-8ffa-317918d769ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.633229 Oct 23 02:14:10.576152 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 169/343] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:09 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:11.604179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:11.604789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:11.618771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:11.619270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:11.619998 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:11.620715 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:11.621165 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:11.622426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:12.297606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:12.310832 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2a35ec7d-be5f-4f7c-9e7d-350f40fd06fd tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.711216 Oct 23 02:14:12.312245 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 175/344] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:11 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:12.479627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-63150ed3-da89-4827-baf2-bd458e5307aa req-67825fce-3f40-4237-a125-5186571d3a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fc5747-8451-4657-979e-570ad7e73b8b", "tag": "91964ab3-6465-4503-be0d-3facc3db73f3"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:12.501211 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-63150ed3-da89-4827-baf2-bd458e5307aa req-67825fce-3f40-4237-a125-5186571d3a5c service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:12.507958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-63150ed3-da89-4827-baf2-bd458e5307aa req-67825fce-3f40-4237-a125-5186571d3a5c service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:12.510654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-63150ed3-da89-4827-baf2-bd458e5307aa req-67825fce-3f40-4237-a125-5186571d3a5c service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:12.545478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-63150ed3-da89-4827-baf2-bd458e5307aa req-67825fce-3f40-4237-a125-5186571d3a5c service nova] Creating event network-changed:91964ab3-6465-4503-be0d-3facc3db73f3 for instance 91fc5747-8451-4657-979e-570ad7e73b8b on hv-cinder-86149 Oct 23 02:14:12.571243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-63150ed3-da89-4827-baf2-bd458e5307aa req-67825fce-3f40-4237-a125-5186571d3a5c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095841 Oct 23 02:14:12.578370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 170/345] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:13.376878 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:13.377756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:13.385169 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:13.386127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:13.386739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:13.388120 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:13.388795 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:13.390726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:14.003434 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:14.015691 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5e615adf-0b8a-4e3c-acb1-bebac59d732f tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.648993 Oct 23 02:14:14.020458 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 176/346] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:13 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:14.595480 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-f421dbe8-8a1e-4567-b0eb-725f50a29196 req-172155b0-6232-4bb3-a0f0-80187c872a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db07175d-130c-4921-9d80-695f6a7d3d0c", "tag": "e35e85c2-0e59-4bf7-a05a-481d96c99ce9"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:14.618887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-f421dbe8-8a1e-4567-b0eb-725f50a29196 req-172155b0-6232-4bb3-a0f0-80187c872a60 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:14.621175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-f421dbe8-8a1e-4567-b0eb-725f50a29196 req-172155b0-6232-4bb3-a0f0-80187c872a60 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:14.621841 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-f421dbe8-8a1e-4567-b0eb-725f50a29196 req-172155b0-6232-4bb3-a0f0-80187c872a60 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:14.658342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-f421dbe8-8a1e-4567-b0eb-725f50a29196 req-172155b0-6232-4bb3-a0f0-80187c872a60 service nova] Creating event network-changed:e35e85c2-0e59-4bf7-a05a-481d96c99ce9 for instance db07175d-130c-4921-9d80-695f6a7d3d0c on hv-cinder-86149 Oct 23 02:14:14.671956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-f421dbe8-8a1e-4567-b0eb-725f50a29196 req-172155b0-6232-4bb3-a0f0-80187c872a60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078958 Oct 23 02:14:14.673307 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 171/347] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:15.052562 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:15.053181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:15.089290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:15.093142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:15.094188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:15.095124 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:15.098264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:15.098952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:15.394279 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:15.404166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-247109aa-249f-49d2-882c-60b3a099edba tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.355635 Oct 23 02:14:15.408548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 177/348] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:15 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:16.434033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:16.434836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:16.450603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:16.451455 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:16.451934 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:16.452704 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:16.453168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:16.453607 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:16.532502 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:16.750691 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:16.759049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-49601d45-dddb-45f4-83c8-34effb934f10 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.329474 Oct 23 02:14:16.760809 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 172/349] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:16 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:17.783263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:17.784467 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:17.798925 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:17.807047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=6 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:17.813530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:17.815395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:17.824461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:17.827005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:17.829755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:17.831303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:18.096751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:18.111598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d07048d2-9640-402e-b18d-377ecdaf6bc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.331777 Oct 23 02:14:18.114304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 178/350] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:17 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:19.139247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:19.140672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:19.143737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:19.149812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:19.150816 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:19.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:19.152405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:19.153076 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:19.153740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:19.519452 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:19.529345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ba83d9dd-d2cf-4a9b-81ac-256653ce292e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.395126 Oct 23 02:14:19.538181 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 173/351] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:19 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:19.866955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-049efcc0-1f87-4576-8c83-a66a05984524 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Action: 'create', calling method: .version_select at 0x7f9da3287a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1437934688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4QLl0hrlBm8g8zN40ond1i3zu2t4L3wsAKnjCy8xdbNkk4vbpZqgHtiRHSUheeAyueeiF1T6ePDkIbTkLWUBO202rUv9Bu6OgnKa8FTd0sy+dfyDkgMdGXD3tOjW6OUA=="}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:19.883844 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-049efcc0-1f87-4576-8c83-a66a05984524 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Getting quotas for project d7bb15a157314fb095d2333f64ab0c83. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:14:19.888231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-049efcc0-1f87-4576-8c83-a66a05984524 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Getting quotas for user 102283eee43142f29645e3faa6501891 and project d7bb15a157314fb095d2333f64ab0c83. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:14:19.912198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-049efcc0-1f87-4576-8c83-a66a05984524 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.210394 Oct 23 02:14:19.913025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 179/352] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:14:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:20.555809 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:20.556822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:20.565677 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:20.566170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:20.566669 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:20.567547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:20.568006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:20.568441 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:20.874995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:20.884563 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8ce077a6-6974-4579-82f9-3d745f32e5e1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.332586 Oct 23 02:14:20.903917 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 174/353] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:20 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:21.910817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:21.911417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:21.919135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:21.925741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:21.926688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:21.927586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:21.928197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:21.928789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:22.129972 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:22.138577 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5e7f2f7a-54c0-4b90-b28d-495de645d488 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.231945 Oct 23 02:14:22.139159 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 180/354] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:21 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:23.161633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:23.162243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:23.170155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:23.170885 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:23.171412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:23.172220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:23.172734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:23.173224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:23.313716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:23.321937 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5cd4978b-2b4b-47dc-958f-fb2196fc3146 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.164065 Oct 23 02:14:23.322772 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 175/355] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:23 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:24.347202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:24.347936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:24.354183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:24.354784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:24.355733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:24.356080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:24.356626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:24.357074 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:24.498531 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:24.510096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e38d1adc-6d20-4474-98aa-b85164fd41c1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.166795 Oct 23 02:14:24.510774 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 181/356] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:24 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:14:25.535145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:25.535678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:25.543072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:25.543698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:25.544157 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:25.545082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:25.545716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:25.546162 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:25.710316 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:25.718326 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ea253d11-10d8-4c30-aff1-0a56d71c5273 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.187154 Oct 23 02:14:25.719065 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 176/357] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:25 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:14:26.589673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-1a0133de-64e0-49a2-8297-271c83345f3c req-b7b93a13-0e4f-4785-8491-31cc618f9886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db07175d-130c-4921-9d80-695f6a7d3d0c", "name": "network-vif-plugged", "status": "completed", "tag": "e35e85c2-0e59-4bf7-a05a-481d96c99ce9"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:26.601368 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1a0133de-64e0-49a2-8297-271c83345f3c req-b7b93a13-0e4f-4785-8491-31cc618f9886 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:26.602634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1a0133de-64e0-49a2-8297-271c83345f3c req-b7b93a13-0e4f-4785-8491-31cc618f9886 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:26.603100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1a0133de-64e0-49a2-8297-271c83345f3c req-b7b93a13-0e4f-4785-8491-31cc618f9886 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:26.615598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-1a0133de-64e0-49a2-8297-271c83345f3c req-b7b93a13-0e4f-4785-8491-31cc618f9886 service nova] Creating event network-vif-plugged:e35e85c2-0e59-4bf7-a05a-481d96c99ce9 for instance db07175d-130c-4921-9d80-695f6a7d3d0c on hv-cinder-86149 Oct 23 02:14:26.621633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-1a0133de-64e0-49a2-8297-271c83345f3c req-b7b93a13-0e4f-4785-8491-31cc618f9886 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035330 Oct 23 02:14:26.622222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 182/358] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:26.741087 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:26.741817 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:26.748302 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:26.748787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:26.749228 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:26.749922 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:26.750375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:26.750824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:26.891202 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:26.899194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a36423be-26ca-41a2-a310-7ea786c740ec tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.161843 Oct 23 02:14:26.899771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 177/359] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:26 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:27.924613 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:27.925305 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:27.927452 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:27.933252 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.933739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.934175 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:27.935026 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:27.935614 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:27.936043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:28.071827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:28.080003 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-02125e53-dd44-48c3-aca7-64be5b1a4bdc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1265 microversion: 2.1 time: 0.160299 Oct 23 02:14:28.080576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 183/360] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:27 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:29.104048 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:29.104571 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:29.111750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:29.112237 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:29.112676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:29.113368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:29.113820 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:29.114248 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:29.245942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:29.254868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a5f8149c-1e60-4914-bb31-244783319a57 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1453 microversion: 2.1 time: 0.154682 Oct 23 02:14:29.255436 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 178/361] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:29 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:29.277039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:29.277647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:29.283787 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:29.284268 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:29.284699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:29.285381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:29.285830 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:29.286250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:29.429001 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:29.436797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-06b4a25a-fc07-48a5-a730-2f3fd0d06ee4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1453 microversion: 2.1 time: 0.163516 Oct 23 02:14:29.437356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 184/362] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:29 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:31.209402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-ec73e884-3651-43af-bfa9-b63dcf9e607d req-25c22394-5ed1-47d5-9501-a41475c76388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db07175d-130c-4921-9d80-695f6a7d3d0c", "tag": "e35e85c2-0e59-4bf7-a05a-481d96c99ce9"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:31.219968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-ec73e884-3651-43af-bfa9-b63dcf9e607d req-25c22394-5ed1-47d5-9501-a41475c76388 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:31.220465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-ec73e884-3651-43af-bfa9-b63dcf9e607d req-25c22394-5ed1-47d5-9501-a41475c76388 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:31.220968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-ec73e884-3651-43af-bfa9-b63dcf9e607d req-25c22394-5ed1-47d5-9501-a41475c76388 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:31.233219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-ec73e884-3651-43af-bfa9-b63dcf9e607d req-25c22394-5ed1-47d5-9501-a41475c76388 service nova] Creating event network-changed:e35e85c2-0e59-4bf7-a05a-481d96c99ce9 for instance db07175d-130c-4921-9d80-695f6a7d3d0c on hv-cinder-86149 Oct 23 02:14:31.238262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-ec73e884-3651-43af-bfa9-b63dcf9e607d req-25c22394-5ed1-47d5-9501-a41475c76388 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032967 Oct 23 02:14:31.238931 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 179/363] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:35.453140 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:35.453678 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:35.455420 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=4 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:35.460965 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:35.461450 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:35.461882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:35.462593 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:35.463047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:35.463468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:35.489900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3b532a1c-ff22-47f2-82b5-9d38f7d9e246 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/ips" status: 200 len: 152 microversion: 2.20 time: 0.040897 Oct 23 02:14:35.490716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 185/364] 10.222.0.23 () {60 vars in 1289 bytes} [Sun Oct 23 02:14:35 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:14:35.536358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:35.537005 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:35.544864 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:35.545360 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:35.545795 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:35.546540 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:35.546984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:35.547416 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:35.551232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=75 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:35.571144 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0643f384-6010-42d7-b371-0d0004b74be3 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/ips" status: 200 len: 145 microversion: 2.1 time: 0.039634 Oct 23 02:14:35.571903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 180/365] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:14:35 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:39.070521 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:39.071075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:39.077128 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:39.077601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:39.078029 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:39.078740 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:39.079186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:39.079603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:39.081888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=72 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:39.102874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lazy-loading 'flavor' on Instance uuid 847628be-0620-4309-99c8-6036d43d26f7 {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:14:39.292183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4b9abf29-5242-47dc-8092-2a12e67011cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/action" status: 202 len: 0 microversion: 2.20 time: 0.225405 Oct 23 02:14:39.292822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 186/366] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 23 02:14:39 2022] POST /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:14:39.302533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:39.303236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:39.310847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:39.311388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:39.311899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:39.312599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:39.313054 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:39.313482 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:39.446488 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:39.455025 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:39.456460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:39.457597 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a6d18c4b-eeb8-44e9-88ed-33932d5618aa tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.159347 Oct 23 02:14:39.458147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 181/367] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:39 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:40.485874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:40.486686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:40.492960 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:40.493436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:40.493862 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:40.494575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:40.495021 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:40.495443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:40.624003 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:40.631935 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:40.633358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:40.634516 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9d45f2de-df94-4937-be02-8f0a07ff5242 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.153933 Oct 23 02:14:40.635061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 187/368] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:40 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:40.761974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3e9ebd2-ad9a-427f-b14c-37437a1aec01"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:40.764295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:40.770646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:40.771131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:40.771571 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:40.772261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:40.772717 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:40.773139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:41.081580 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d4bb05e0-0e78-47a5-bac8-951d217c445c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323278 Oct 23 02:14:41.082176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 182/369] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:14:40 2022] POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:14:41.660460 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:41.661067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:41.667307 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:41.667828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:41.668355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:41.668926 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:41.669367 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:41.669784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:41.800882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:41.809810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:41.811349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:41.812576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6ce5a534-5c27-4dbc-a5ec-01dad44218f1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.156126 Oct 23 02:14:41.813135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 188/370] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:41 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:42.839572 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:42.841136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:42.847392 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:42.847874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:42.848311 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:42.848996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:42.849446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:42.849864 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:42.980062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:42.988102 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:42.989627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:42.990820 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0311bc2a-2758-4818-83c6-0915d1e831b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.156246 Oct 23 02:14:42.991382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 183/371] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:42 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:44.017065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:44.017656 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:44.023549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:44.024026 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:44.024460 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:44.025139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:44.025590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:44.026014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:44.154660 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:44.162958 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:44.164401 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:44.165543 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8311e350-3833-4a58-a1a2-1cc9a2f812e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.152406 Oct 23 02:14:44.166100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 189/372] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:44 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:45.191635 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:45.192241 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:45.198632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:45.199780 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:45.200214 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:45.200899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:45.201344 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:45.201761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:45.330401 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:45.338823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:45.340664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:45.341733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7b4480bd-f7cc-4840-90ac-6cf22a1cb5ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.153981 Oct 23 02:14:45.342375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 184/373] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:45 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:46.366302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:46.366950 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:46.372899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:46.373378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:46.373812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:46.374530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:46.374985 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:46.375404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:46.504652 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:46.513157 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:46.514632 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:46.515812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d6ea3df5-09e3-4030-aa4c-47a2f30836e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.153384 Oct 23 02:14:46.516365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 190/374] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:46 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:47.427205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1691894936", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1437934688", "security_groups": [{"name": "tempest-secgroup-smoke-452482644"}], "networks": [{"uuid": "5ff0d7db-4994-4f32-abfd-4e23a0f82087"}], "block_device_mapping_v2": [{"uuid": "ce772bf4-f6d0-49a3-b152-ccbb727926f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:47.543130 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:47.544004 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:47.551178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:47.551662 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:47.552088 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:47.552784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:47.553230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:47.553642 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:47.569575 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] validate_networks() for [('5ff0d7db-4994-4f32-abfd-4e23a0f82087', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:14:47.785372 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:47.800259 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:47.802355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:47.803951 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bff5589d-3099-4d4a-bac9-e6bfb2c85c0a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.264865 Oct 23 02:14:47.804739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 191/375] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:47 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:48.066977 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:14:48.067404 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:14:48.067876 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:14:48.068314 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:14:48.068728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:14:48.077804 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:48.078281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:48.078755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:48.079478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:48.079921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:48.080346 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:48.099988 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Getting quotas for project d7bb15a157314fb095d2333f64ab0c83. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:14:48.104051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Getting quotas for user 102283eee43142f29645e3faa6501891 and project d7bb15a157314fb095d2333f64ab0c83. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:14:48.166041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:14:48.168852 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce772bf4-f6d0-49a3-b152-ccbb727926f7',volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:14:48.313940 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2c156c11-32ef-4b3a-9c73-e5d81dbd817f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.891301 Oct 23 02:14:48.314611 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 185/376] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:14:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:14:48.325741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-116f84fa-3ab1-419a-8829-09d3025edad0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:48.326347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-116f84fa-3ab1-419a-8829-09d3025edad0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:48.396595 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-116f84fa-3ab1-419a-8829-09d3025edad0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:48.406051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-116f84fa-3ab1-419a-8829-09d3025edad0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1089 microversion: 2.1 time: 0.084206 Oct 23 02:14:48.406764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 192/377] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:48 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:48.678396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d6fb699b-c66d-4369-b730-b48bbd07a5d7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:48.685554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fb699b-c66d-4369-b730-b48bbd07a5d7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:48.686048 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fb699b-c66d-4369-b730-b48bbd07a5d7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:48.686515 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d6fb699b-c66d-4369-b730-b48bbd07a5d7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:48.748829 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d6fb699b-c66d-4369-b730-b48bbd07a5d7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Going to try to stop instance {{(pid=118878) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 02:14:48.795528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d6fb699b-c66d-4369-b730-b48bbd07a5d7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/action" status: 202 len: 0 microversion: 2.1 time: 0.120862 Oct 23 02:14:48.796197 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 186/378] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:14:48 2022] POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:14:48.804151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:48.804771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:48.810843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:48.811564 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:48.812167 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:48.813044 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:48.813693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:48.814308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:48.834798 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:48.835457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:48.843188 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:48.843832 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:48.844690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:48.845609 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:48.846078 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:48.846538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:49.247799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:49.254715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:49.257231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9e6be65c-8f79-48d2-89fe-8991ce8df05a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.456879 Oct 23 02:14:49.258127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 193/379] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:48 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:14:49.265855 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:49.267368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:49.268550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ff0d8895-028d-4475-b871-b30e2bdce52f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.439659 Oct 23 02:14:49.269121 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 187/380] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:48 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:49.429125 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:49.429732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:49.435959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:49.436447 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:49.436894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:49.437584 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:49.438037 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:49.438479 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:49.500035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:49.507509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9a7e24f7-64d0-4b8e-91f8-097326eecd16 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1187 microversion: 2.1 time: 0.082196 Oct 23 02:14:49.508054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 194/381] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:49 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1187 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:50.281367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:50.282285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:50.287509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:50.291226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:50.291984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:50.293193 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:50.294516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:50.295042 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:50.295546 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:50.295944 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:50.297142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:50.303538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:50.304315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:50.304996 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:50.305936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:50.306469 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:50.307131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:50.564265 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:50.572798 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e5bf671b-13a1-4a22-8307-122e7ffb0757 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.295412 Oct 23 02:14:50.573468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 188/382] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:50 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:50.578303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:50.578947 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:50.582643 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:50.591547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:50.593068 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:50.594238 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:50.594359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-02395baf-6c53-4e0f-b792-0dd53775e2d1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.302687 Oct 23 02:14:50.594768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:50.595117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 195/383] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:50 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:14:50.595855 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:50.596710 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:50.597328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:50.597778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:50.691396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:50.699472 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d4a9b841-0fe3-47c7-b684-4141d209ba59 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1205 microversion: 2.1 time: 0.124654 Oct 23 02:14:50.700046 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 189/384] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:50 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1205 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:51.597043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:51.597646 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:51.603539 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:51.604017 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:51.604450 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:51.605163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:51.605813 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:51.606240 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:51.620929 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:51.622276 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:51.629122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:51.629617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:51.630050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:51.630780 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:51.631234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:51.631656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:51.878968 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:51.887742 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-377b809b-3d31-4f2b-818d-460f61b4e912 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.294536 Oct 23 02:14:51.888310 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 196/385] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:51 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:51.892800 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:51.893396 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:51.899556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:51.900028 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:51.900646 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:51.901055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:51.901794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:51.902464 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:51.903043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:51.910721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:51.912516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:51.914080 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-29965325-2964-4ffb-8f60-380716d1cd99 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.296990 Oct 23 02:14:51.914912 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 190/386] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:51 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:52.109909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-7b22a983-684a-4826-9415-e2b87d9506b2 req-414e4fee-5610-4892-a001-544f3f5e0b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e059be-46de-46ff-bbf2-55cb5c6b72ad", "tag": "d232d5a5-a6d8-44ab-a498-c1ef3fea2467"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:14:52.117426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:52.119917 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-7b22a983-684a-4826-9415-e2b87d9506b2 req-414e4fee-5610-4892-a001-544f3f5e0b7d service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:52.121221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-7b22a983-684a-4826-9415-e2b87d9506b2 req-414e4fee-5610-4892-a001-544f3f5e0b7d service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:52.121823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-7b22a983-684a-4826-9415-e2b87d9506b2 req-414e4fee-5610-4892-a001-544f3f5e0b7d service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:52.130641 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-10ffdfa2-fcad-4072-b328-1bde5d2da465 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.241253 Oct 23 02:14:52.131493 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 197/387] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:51 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:52.147121 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-7b22a983-684a-4826-9415-e2b87d9506b2 req-414e4fee-5610-4892-a001-544f3f5e0b7d service nova] Creating event network-changed:d232d5a5-a6d8-44ab-a498-c1ef3fea2467 for instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad on hv-cinder-86149 Oct 23 02:14:52.152510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-7b22a983-684a-4826-9415-e2b87d9506b2 req-414e4fee-5610-4892-a001-544f3f5e0b7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046026 Oct 23 02:14:52.153416 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 191/388] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:14:52.911569 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:52.912170 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:52.918749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:52.919226 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:52.919653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:52.920324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:52.920766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:52.921179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:52.942000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:52.942738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:52.948751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:52.949233 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:52.949670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:52.950367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:52.950844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:52.951269 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:53.112273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:53.121053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-30e289d8-1073-4655-98d7-af26d7a23408 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.212960 Oct 23 02:14:53.121633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 198/389] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:52 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:53.126143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:53.134417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:53.136553 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:53.137813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6ff09b05-2eac-4c73-85cf-6fe679bd4088 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.200486 Oct 23 02:14:53.138366 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 192/390] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:52 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:14:53.154010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:53.154672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:53.160506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:53.160983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:53.161739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:53.162403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:53.162937 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:53.163353 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:53.294251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:53.301762 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-38d1f181-6cc6-4030-bced-e8628c75a1d8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.152707 Oct 23 02:14:53.302317 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 199/391] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:53 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:54.144974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:54.145620 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:54.152601 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:54.153079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:54.153514 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:54.154205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:54.154681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:54.155107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:54.163415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:54.164157 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:54.171476 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:54.171630 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:54.172193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:54.173012 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:54.173559 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:54.174079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:54.436454 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:54.445061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c5444a72-dc55-464c-bfea-0068729dca87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.303881 Oct 23 02:14:54.445837 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 193/392] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:54 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:54.450867 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:54.451555 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:54.454866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:54.457659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:54.458219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:54.458785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:54.459689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:54.460357 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:54.460780 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:54.467096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:54.468770 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:54.470253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2efcc070-4179-46cb-9bfc-3d9a8003c4e5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.310923 Oct 23 02:14:54.471505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 200/393] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:54 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:14:54.609168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:54.618863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-de3b3ddf-ff95-402e-bd58-1f48f04801b4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.171743 Oct 23 02:14:54.619446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 194/394] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:54 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:55.469537 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:55.470174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:55.475986 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:55.476462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:55.476887 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:55.477563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:55.478005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:55.478418 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:55.497499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:55.498106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:55.504487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:55.504965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:55.505392 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:55.506073 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:55.506556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:55.506974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:55.684739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:55.688016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:55.696223 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:55.697081 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3eb5ba84-2fba-4f1e-b501-c1ba27bacf87 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.231327 Oct 23 02:14:55.697650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 201/395] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:55 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:55.702805 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:55.703370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:55.705406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:55.707016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:55.708249 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2df5dd6e-b76b-4b4a-b32e-2382062ebc6b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.215814 Oct 23 02:14:55.714244 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 195/396] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:55 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:14:55.714612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:55.714612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:55.714612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:55.714612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:55.714957 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:55.714957 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:55.841598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:55.849175 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f4d183bd-f1f0-43d2-8df9-d1c6ddb8110c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.150486 Oct 23 02:14:55.849760 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 202/397] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:55 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:56.720926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:56.721537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:56.727977 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:56.728468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:56.728903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:56.730342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:56.730821 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:56.731247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:56.733970 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:56.734943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:56.735809 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:56.741673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:56.742146 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:56.742619 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:56.743296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:56.743738 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:56.744153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:56.930007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:56.937055 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:56.938467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b0717c67-a0b5-41ca-a796-2d6792ec9117 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.221509 Oct 23 02:14:56.939055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 196/398] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:56 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:56.943558 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:56.944163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:56.945278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:56.946726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:56.948547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9b6b1bb6-0da3-4f1c-b2d3-5889fe01563a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1744 microversion: 2.20 time: 0.216879 Oct 23 02:14:56.949243 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 203/399] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:56 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1744 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:14:56.955450 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:56.955450 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:56.955450 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:56.955450 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:56.955830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:56.955830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:57.082863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:57.091087 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-be744654-cd92-484b-82be-c06f85a450c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.151081 Oct 23 02:14:57.091649 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 197/400] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:56 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:57.962987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:57.964079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:57.965993 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=44 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:57.971417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:57.972039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:57.972330 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:57.973173 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:57.973785 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:57.973901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:57.975116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:57.976283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:57.985082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:57.985712 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:57.986150 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:57.986955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:57.987528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:57.988133 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:58.089387 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:58.112052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=6 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:58.172757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:58.176703 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:58.180987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e59ceffc-ccc2-4b6e-925f-f6ce077afb96 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.221916 Oct 23 02:14:58.181552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 204/401] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:57 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:58.184803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:58.186406 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:58.186822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:58.187031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:58.187986 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ba059904-85c7-4019-a327-4ed1bddbeb1f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1744 microversion: 2.20 time: 0.217527 Oct 23 02:14:58.188537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 198/402] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:57 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1744 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:14:58.193191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:58.193669 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:58.194096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:58.194806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:58.195258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:58.195680 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:58.329363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:58.336933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-197ad5b9-2794-4b9c-8106-c1ba18577091 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.154446 Oct 23 02:14:58.337488 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 205/403] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:58 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:59.204775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:59.205382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:59.212701 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:59.212873 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:59.213362 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:59.214200 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:59.214922 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:59.215368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:59.215467 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:59.216053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:59.217234 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:14:59.222679 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:59.223153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:59.223578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:59.224251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:59.224698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:59.225248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:59.410372 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:59.413866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:59.419087 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0573edc2-c781-4746-8250-aa43556a5d8d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.218138 Oct 23 02:14:59.419668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 199/404] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:59 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:14:59.422285 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:59.423757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:59.425080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5a2bca96-9033-436d-aa97-24f4d0755493 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1744 microversion: 2.20 time: 0.216061 Oct 23 02:14:59.441561 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 206/405] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:14:59 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:14:59.441737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:14:59.441737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:14:59.441737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:59.441737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:59.442085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:59.442085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:14:59.442085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:14:59.442085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:14:59.568134 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:14:59.576391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e09a756b-3826-4461-a61e-939cd458e9f8 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.152780 Oct 23 02:14:59.576903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 200/406] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:14:59 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:00.443521 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:00.444335 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:00.451553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:00.451862 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:00.452297 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:00.452455 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:00.452568 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:00.453139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:00.453589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:00.453998 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:00.458784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:00.459270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:00.459707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:00.460400 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:00.460864 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:00.461343 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:00.650989 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:00.655064 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:00.659647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-96aaa488-1d9c-4b59-af0a-7efe13a57d32 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1723 microversion: 2.1 time: 0.220377 Oct 23 02:15:00.661863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 207/407] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:00 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:00.663517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:00.664944 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:00.666094 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3bda3089-bb09-44cb-9ad5-8137410907d9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1744 microversion: 2.20 time: 0.218786 Oct 23 02:15:00.666925 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:00.678481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 201/408] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:00 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1744 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:00.678653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:00.684536 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:00.685030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:00.685456 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:00.686160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:00.686635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:00.687054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:00.771300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-97545d95-a1b4-422c-bdc3-e533d74e8910 req-2f0f5944-6d96-4b4f-9e79-32604955f100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847628be-0620-4309-99c8-6036d43d26f7", "name": "network-vif-plugged", "status": "completed", "tag": "24fbd91b-949f-4c46-a496-148c4722eb45"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:00.781519 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-97545d95-a1b4-422c-bdc3-e533d74e8910 req-2f0f5944-6d96-4b4f-9e79-32604955f100 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:00.781996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-97545d95-a1b4-422c-bdc3-e533d74e8910 req-2f0f5944-6d96-4b4f-9e79-32604955f100 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:00.782428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-97545d95-a1b4-422c-bdc3-e533d74e8910 req-2f0f5944-6d96-4b4f-9e79-32604955f100 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:00.795125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-97545d95-a1b4-422c-bdc3-e533d74e8910 req-2f0f5944-6d96-4b4f-9e79-32604955f100 service nova] Creating event network-vif-plugged:24fbd91b-949f-4c46-a496-148c4722eb45 for instance 847628be-0620-4309-99c8-6036d43d26f7 on hv-cinder-86149 Oct 23 02:15:00.800145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-97545d95-a1b4-422c-bdc3-e533d74e8910 req-2f0f5944-6d96-4b4f-9e79-32604955f100 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032432 Oct 23 02:15:00.801147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 202/409] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:15:00.823801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:00.831560 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-853c9df8-e7a3-4206-9322-bcf9848747c3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.170142 Oct 23 02:15:00.832321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 208/410] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:00 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:01.685914 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:01.686651 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:01.693944 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:01.694546 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:01.695017 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:01.695222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:01.695750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:01.695875 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:01.696206 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:01.696638 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:01.702306 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:01.702820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:01.703250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:01.703932 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:01.704380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:01.704797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:01.897457 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:01.902091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:01.905851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:01.907358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:01.908512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-739f551a-9725-4d44-8764-ebe9e8f03683 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1744 microversion: 2.20 time: 0.217075 Oct 23 02:15:01.909064 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 209/411] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:01 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:01.910193 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f3ffc954-b9e9-4c7b-a9c4-075cb9f24052 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1700 microversion: 2.1 time: 0.229528 Oct 23 02:15:01.911195 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 203/412] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:01 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1700 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:01.913718 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:01.914321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:01.920405 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:01.920889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:01.921328 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:01.922013 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:01.922484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:01.922909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:01.933212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-74221410-44d8-4797-8a55-f0c64b83d1b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:01.939190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74221410-44d8-4797-8a55-f0c64b83d1b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:01.939612 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74221410-44d8-4797-8a55-f0c64b83d1b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:01.940049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74221410-44d8-4797-8a55-f0c64b83d1b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:01.962466 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-74221410-44d8-4797-8a55-f0c64b83d1b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Going to try to start instance {{(pid=118878) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 02:15:02.005731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-74221410-44d8-4797-8a55-f0c64b83d1b1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/action" status: 202 len: 0 microversion: 2.1 time: 0.076577 Oct 23 02:15:02.006675 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 204/413] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:15:01 2022] POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:15:02.015032 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:02.015740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:02.022125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:02.022677 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:02.023130 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:02.023816 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:02.024344 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:02.024702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:02.083443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:02.091863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b56e1c57-ffe0-4338-890a-8f2514e745a0 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.181806 Oct 23 02:15:02.092603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 210/414] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:01 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:02.174722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:02.183629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-96223cb2-6b5c-4ae6-bd24-fb75b4b7a73a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1709 microversion: 2.1 time: 0.172837 Oct 23 02:15:02.184192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 205/415] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:02 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:02.933949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:02.934598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:02.940538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:02.941023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:02.941498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:02.942197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:02.942676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:02.943097 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:03.074131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:03.082134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:03.083615 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:03.084761 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8bfd1de0-eb35-4298-a4c3-19b7f31a2fbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1744 microversion: 2.20 time: 0.154774 Oct 23 02:15:03.085319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 211/416] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:02 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:03.114328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:03.115027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:03.121985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:03.122494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:03.122936 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:03.123628 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:03.124083 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:03.124511 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:03.207875 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:03.208485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:03.214727 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:03.215215 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:03.215648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:03.216337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:03.216789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:03.217210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:03.266580 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:03.274213 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d32e26ed-fa6a-4034-bb0a-4aeaa4ce31f6 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.163874 Oct 23 02:15:03.274830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 206/417] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:03 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:03.350348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:03.358740 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-352d711c-1eaa-4259-8b38-e550096a2803 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1709 microversion: 2.1 time: 0.154589 Oct 23 02:15:03.359306 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 212/418] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:03 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:15:04.110692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:04.111332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:04.117265 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:04.117832 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:04.118168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:04.118887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:04.119475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:04.119907 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:04.247709 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:04.255818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:04.257329 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:04.258514 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-24d54786-efba-4642-93ad-36d0ade6c20c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1744 microversion: 2.20 time: 0.151800 Oct 23 02:15:04.259079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 207/419] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:04 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:04.297822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:04.298430 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:04.304339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:04.304820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:04.305250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:04.305924 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:04.306374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:04.307599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:04.382858 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:04.383348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:04.389855 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:04.390338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:04.390801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:04.391492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:04.391942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:04.392360 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:04.448367 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:04.456069 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-fd608759-9fa2-427b-91a7-718ed3db0546 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.162013 Oct 23 02:15:04.456634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 213/420] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:04 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:15:04.536900 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:04.545601 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a6fe07c2-4e06-451c-8bd5-15136bf608a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1709 microversion: 2.1 time: 0.166845 Oct 23 02:15:04.546198 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 208/421] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:04 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:15:05.156304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-f9d9ebbb-adf8-4311-8f92-b71d06b618ac req-51549189-2f6d-46be-aa7b-ef3804020e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e059be-46de-46ff-bbf2-55cb5c6b72ad", "name": "network-vif-plugged", "status": "completed", "tag": "d232d5a5-a6d8-44ab-a498-c1ef3fea2467"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:05.167013 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f9d9ebbb-adf8-4311-8f92-b71d06b618ac req-51549189-2f6d-46be-aa7b-ef3804020e1d service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:05.167488 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f9d9ebbb-adf8-4311-8f92-b71d06b618ac req-51549189-2f6d-46be-aa7b-ef3804020e1d service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:05.167922 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f9d9ebbb-adf8-4311-8f92-b71d06b618ac req-51549189-2f6d-46be-aa7b-ef3804020e1d service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:05.179000 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-f9d9ebbb-adf8-4311-8f92-b71d06b618ac req-51549189-2f6d-46be-aa7b-ef3804020e1d service nova] Creating event network-vif-plugged:d232d5a5-a6d8-44ab-a498-c1ef3fea2467 for instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad on hv-cinder-86149 Oct 23 02:15:05.184111 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-f9d9ebbb-adf8-4311-8f92-b71d06b618ac req-51549189-2f6d-46be-aa7b-ef3804020e1d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031791 Oct 23 02:15:05.184963 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 214/422] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:15:05.282976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:05.283526 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:05.290150 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:05.290673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:05.291157 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:05.291846 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:05.292301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:05.292728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:05.425164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:05.435670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:05.437129 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:05.438426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-69bb763f-89f4-4b25-aff5-24094964a5b2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1744 microversion: 2.20 time: 0.159389 Oct 23 02:15:05.439009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 209/423] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:05 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:05.478874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:05.479606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:05.485841 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:05.486322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:05.486822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:05.487502 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:05.487950 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:05.488369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:05.569165 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:05.569775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:05.578840 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:05.579610 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:05.580270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:05.581244 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:05.581945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:05.582549 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:05.637276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:05.646224 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-95f18b0f-24b0-4034-b8c2-e5881b768ce7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.171634 Oct 23 02:15:05.658469 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 215/424] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:05 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:05.804976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:05.815899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f825862a-ff73-4f2f-bc5b-70888bdd11c5 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1713 microversion: 2.1 time: 0.250609 Oct 23 02:15:05.816475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 210/425] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:05 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1713 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:15:06.467593 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:06.468369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:06.474726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:06.475203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:06.475843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:06.476558 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:06.477007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:06.477426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:06.641530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:06.654763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:06.656670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:06.657961 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e7ae510a-fdf6-4879-ab5e-4652a261d1bc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.194509 Oct 23 02:15:06.658612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 216/426] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:06 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:06.676734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:06.678725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:06.686793 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:06.687579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:06.688434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:06.689406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:06.690073 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:06.690909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:06.848189 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:06.859634 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7249ad7e-d929-4fca-badd-f50a406bc484 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1260 microversion: 2.1 time: 0.191596 Oct 23 02:15:06.860554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 211/427] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:06 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:07.684813 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:07.686946 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:07.693650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:07.694489 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:07.695028 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:07.695800 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:07.696345 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:07.697192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:07.856006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:07.864956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:07.866833 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:07.867899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9d5136f9-e4a5-4bf5-ac7c-4590584682ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.187132 Oct 23 02:15:07.870479 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 217/428] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:07 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:07.887515 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:07.888714 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:07.895701 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:07.896189 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:07.897193 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:07.898028 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:07.898918 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:07.899345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:07.926749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:08.071012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:08.080498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-278fcaa9-9a9f-47cd-8099-1f1894558447 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1443 microversion: 2.1 time: 0.199205 Oct 23 02:15:08.081075 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 212/429] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:07 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1443 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:08.106961 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:08.107956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:08.114233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:08.114936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:08.115649 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:08.116548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:08.117247 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:08.117766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:08.282611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:08.292273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-899ae05b-13ac-4246-8834-46697c2a3f8b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1443 microversion: 2.1 time: 0.190285 Oct 23 02:15:08.306691 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 218/430] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:08 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1443 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:15:08.896495 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:08.897226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:08.905653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:08.906210 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:08.907019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:08.907792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:08.908468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:08.910834 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:09.144629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:09.157133 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:09.158739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:09.160550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-057ac41b-5cac-4e18-b4b8-803a9cb1230d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.269574 Oct 23 02:15:09.161184 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 213/431] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:08 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:10.188166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:10.189492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:10.199536 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:10.202685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:10.203346 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:10.204254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:10.205462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:10.208925 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:10.214945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:10.233177 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-bc4e6d65-53e0-4d87-962e-9a9b26076085 req-578fa738-2fec-400e-8d52-c37934952062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e059be-46de-46ff-bbf2-55cb5c6b72ad", "tag": "d232d5a5-a6d8-44ab-a498-c1ef3fea2467"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:10.253870 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bc4e6d65-53e0-4d87-962e-9a9b26076085 req-578fa738-2fec-400e-8d52-c37934952062 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:10.254784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bc4e6d65-53e0-4d87-962e-9a9b26076085 req-578fa738-2fec-400e-8d52-c37934952062 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:10.255504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bc4e6d65-53e0-4d87-962e-9a9b26076085 req-578fa738-2fec-400e-8d52-c37934952062 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:10.278395 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-bc4e6d65-53e0-4d87-962e-9a9b26076085 req-578fa738-2fec-400e-8d52-c37934952062 service nova] Creating event network-changed:d232d5a5-a6d8-44ab-a498-c1ef3fea2467 for instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad on hv-cinder-86149 Oct 23 02:15:10.292461 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-bc4e6d65-53e0-4d87-962e-9a9b26076085 req-578fa738-2fec-400e-8d52-c37934952062 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062814 Oct 23 02:15:10.294872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 214/432] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:15:10.444223 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:10.453378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:10.454883 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:10.456071 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6a245fe7-f81c-48aa-9ce1-8a6ce503e407 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.272950 Oct 23 02:15:10.456737 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 219/433] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:10 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:15:11.483029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:11.484335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:11.491613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:11.492442 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:11.492924 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:11.494603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:11.495281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:11.495910 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:11.718659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:11.731267 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:11.732874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:11.734093 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-46d766cb-05d7-4b0a-8ffb-a75c84d746bf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.255358 Oct 23 02:15:11.752261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 215/434] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:11 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:12.760354 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:12.761055 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:12.767132 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:12.767611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:12.768047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:12.768784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:12.769242 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:12.769717 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:12.909002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:12.918588 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:12.920124 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:12.922959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-dfeee83c-7ebe-4ebc-81f4-225dcdc377b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.166796 Oct 23 02:15:12.923710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 220/435] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:12 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:13.949757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:13.950314 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:13.957070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:13.957554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:13.957989 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:13.958706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:13.959158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:13.959579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:14.099539 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:14.108765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:14.111803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:14.111803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-27f81f6e-045a-4d2a-b93b-57e4c1249eaf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.166727 Oct 23 02:15:14.112413 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 216/436] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:13 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:15.138065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:15.138882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:15.145148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:15.145700 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:15.146207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:15.147162 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:15.147695 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:15.148342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:15.540687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:15.549031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:15.550759 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:15.552169 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-adf363f6-6f25-4fe3-bcda-fc8badfc09c9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.418702 Oct 23 02:15:15.552729 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 221/437] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:15 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:15:16.579884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:16.580502 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:16.587594 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:16.588147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:16.588598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:16.589295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:16.589751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:16.590180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:16.717712 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:16.725761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:16.727242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:16.728456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a634e0d7-0bb8-4430-a0ff-d3bbb96885f2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1739 microversion: 2.20 time: 0.152556 Oct 23 02:15:16.729028 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 217/438] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:16 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:17.753322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:17.754062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:17.760908 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:17.761395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:17.761827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:17.762552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:17.763007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:17.763431 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:17.900095 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:17.908016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:17.909710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:17.910888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0e15c606-6f8c-466d-9420-0a28790c8c89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1721 microversion: 2.20 time: 0.161524 Oct 23 02:15:17.911440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 222/439] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:17 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:18.668906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:18.669438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:18.675852 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:18.676278 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:18.676717 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:18.677402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:18.677855 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:18.678282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:18.704065 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-94cceeae-b62e-4769-8273-16a67cf8ab68 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/ips" status: 200 len: 149 microversion: 2.1 time: 0.039448 Oct 23 02:15:18.704643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 218/440] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:15:18 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:15:18.946661 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:18.948189 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:18.955405 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:18.955885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:18.956311 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:18.957005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:18.957477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:18.957895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:19.097601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:19.106608 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:19.108037 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:19.109163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-edb43695-e1fc-4b9b-98c7-5360beeef03c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1721 microversion: 2.20 time: 0.175916 Oct 23 02:15:19.109713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 223/441] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:18 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:20.072657 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f97306f-d4a0-4470-8017-712846ac2a96"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:20.075066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:20.081842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.082335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.082781 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.083467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.083914 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.084332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.132896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:20.133968 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:20.139463 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.139946 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.140372 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.141047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.141509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.141936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.286428 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:20.295526 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:20.296969 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:20.298114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-117fc2b9-edc4-48be-bd9f-940c0c9f3ae6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1724 microversion: 2.20 time: 0.169044 Oct 23 02:15:20.298701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 224/442] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:20 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:15:20.324741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae91c74c-de9a-4093-8c61-c3bcd38c2c0c"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:20.327324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:20.333630 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.334116 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.334615 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.335491 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.335909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.336380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.390529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ff3f2213-4706-44ca-abee-1055fcc29699 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321642 Oct 23 02:15:20.391721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 219/443] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:15:20 2022] POST /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:15:20.656408 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6d5a2e86-fd27-4f9f-8425-412cc4ff59ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336081 Oct 23 02:15:20.657008 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 225/444] 10.222.0.23 () {62 vars in 1364 bytes} [Sun Oct 23 02:15:20 2022] POST /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:15:20.787317 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:20.787941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:20.790428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=64 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:20.795591 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.796070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.796503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.797192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.797673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.798095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.840849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118878) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 02:15:20.907616 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-783e9228-4b98-4976-91d6-872251cb0d7f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/action" status: 202 len: 0 microversion: 2.20 time: 0.125368 Oct 23 02:15:20.908287 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 220/445] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 23 02:15:20 2022] POST /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:15:20.917317 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:20.917924 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:20.934153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.935026 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.935686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:20.937523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:20.938163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:20.938781 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:21.086134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:21.095375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:21.096795 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:21.097938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2e1cd502-9dfe-4ed8-b991-f111ebe271b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1810 microversion: 2.20 time: 0.185177 Oct 23 02:15:21.099750 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 226/446] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:20 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:21.204862 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-2d663ac8-e38c-40e2-8bd9-e5d89dfaccb0 req-49744414-b727-438a-bcb6-6a62510f8040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847628be-0620-4309-99c8-6036d43d26f7", "name": "network-vif-unplugged", "status": "completed", "tag": "24fbd91b-949f-4c46-a496-148c4722eb45"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:21.216377 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-2d663ac8-e38c-40e2-8bd9-e5d89dfaccb0 req-49744414-b727-438a-bcb6-6a62510f8040 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:21.217002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-2d663ac8-e38c-40e2-8bd9-e5d89dfaccb0 req-49744414-b727-438a-bcb6-6a62510f8040 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:21.217516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-2d663ac8-e38c-40e2-8bd9-e5d89dfaccb0 req-49744414-b727-438a-bcb6-6a62510f8040 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:21.230602 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.compute.server_external_events [req-2d663ac8-e38c-40e2-8bd9-e5d89dfaccb0 req-49744414-b727-438a-bcb6-6a62510f8040 service nova] Unable to find a host for instance 847628be-0620-4309-99c8-6036d43d26f7. Dropping event network-vif-unplugged {{(pid=118878) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 23 02:15:21.231794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-2d663ac8-e38c-40e2-8bd9-e5d89dfaccb0 req-49744414-b727-438a-bcb6-6a62510f8040 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031828 Oct 23 02:15:21.232461 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 221/447] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 23 02:15:22.127090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:22.127679 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:22.134337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:22.134797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:22.135221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:22.135896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:22.136335 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:22.136749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:22.270212 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:22.278778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:22.280196 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:22.281330 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a9e1bc5c-2e8c-4cc0-8abe-56e794ff90f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1752 microversion: 2.20 time: 0.158158 Oct 23 02:15:22.281880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 227/448] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:22 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:23.307300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:23.307916 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:23.314350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:23.314930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:23.315375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:23.316060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:23.316515 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:23.316945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:23.446955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:23.455647 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:23.457092 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:23.458247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ffc321f2-08a9-4ced-ba16-0dca96209274 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1752 microversion: 2.20 time: 0.154776 Oct 23 02:15:23.459063 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 222/449] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:23 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:24.484257 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:24.484892 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:24.490807 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:24.491286 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:24.491724 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:24.493042 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:24.493497 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:24.493921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:24.620764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:24.629155 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:24.630610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:24.631742 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-76aaef66-1cad-4836-9970-4e4823e8766f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1752 microversion: 2.20 time: 0.151403 Oct 23 02:15:24.632300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 228/450] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:24 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:25.656369 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:25.656979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:25.664373 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:25.664907 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:25.665343 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:25.666033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:25.666506 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:25.666936 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:25.799170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:25.810587 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:25.812046 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:25.813199 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b3b1e9d5-0e84-47b3-b263-0f2a9528559f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1752 microversion: 2.20 time: 0.160702 Oct 23 02:15:25.813760 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 223/451] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:25 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:26.838818 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:26.839834 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:26.845984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:26.846494 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:26.846939 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:26.847746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:26.848229 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:26.848699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:26.976093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:26.985085 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:26.986562 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:26.987733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c868a1bf-777a-4983-9b16-2a8852986c9a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1752 microversion: 2.20 time: 0.152776 Oct 23 02:15:26.988308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 229/452] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:26 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:28.013564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:28.014173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:28.020489 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:28.020972 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:28.021403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:28.022095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:28.022567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:28.022991 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:28.163456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:28.173198 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:28.174736 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:28.175910 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-78cb4c20-232c-4f6e-b15d-eddcc3017c23 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1752 microversion: 2.20 time: 0.166211 Oct 23 02:15:28.176460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 224/453] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:28 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:29.009216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c2ef3b46-987d-4d53-afa6-9ac97202c2b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: .version_select at 0x7f9da300fdc0>, body: {"keypair": {"name": "tempest-keypair-1741603251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqoViZ5joszcMB82xgqGc7nV1Fxl7SL8biV/YrBwlH/io2Zg+19XCR+UJ0c1uule5iL8i+cNBP0CgHJD30NWglUactvOx3A0pf7L+Va4HTCHDWkBw/TGKq3f2fHaj4mFA=="}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:29.014468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=52 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:29.026640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-c2ef3b46-987d-4d53-afa6-9ac97202c2b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:15:29.030551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-c2ef3b46-987d-4d53-afa6-9ac97202c2b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for user 66975cf6d8fa417e8df429d4c89ef910 and project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:15:29.056596 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c2ef3b46-987d-4d53-afa6-9ac97202c2b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051956 Oct 23 02:15:29.057190 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 230/454] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:15:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:15:29.201995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:29.202642 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:29.210304 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:29.211154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:29.211868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:29.212822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:29.213277 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:29.213702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:29.355095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:29.365767 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:29.367536 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:29.368965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e666a8c9-8072-4fca-88e7-8c4ee9b9c761 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.170780 Oct 23 02:15:29.369554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 225/455] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:29 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:30.396486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:30.398284 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:30.404714 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:30.405400 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:30.405841 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:30.406577 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:30.407031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:30.407641 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:30.493571 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1129678628", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7b3cf49-41ec-4949-b12a-aff94c1d3d94"}], "security_groups": [{"name": "tempest-securitygroup--1347492029"}], "key_name": "tempest-keypair-1741603251", "user_data": "}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:30.540666 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:30.551455 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:30.552930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:30.554090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-811a841a-1c0e-4654-aac9-36de01c8aeec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.163387 Oct 23 02:15:30.554677 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 231/456] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:30 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:30.600581 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] validate_networks() for [('a7b3cf49-41ec-4949-b12a-aff94c1d3d94', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:15:31.044931 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:15:31.045362 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:15:31.045836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:15:31.046246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:15:31.046703 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:15:31.055888 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:31.056371 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:31.056807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:31.057589 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:31.057982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:31.058607 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:31.076270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:15:31.080276 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for user 66975cf6d8fa417e8df429d4c89ef910 and project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:15:31.091867 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:15:31.094179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:15:31.144094 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c1ace12d-e3af-42c6-b6f5-16d55517b2e1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655531 Oct 23 02:15:31.152691 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 226/457] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:15:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:15:31.158255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-15535043-7468-4339-adfa-fef89f04eed9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:31.160747 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-15535043-7468-4339-adfa-fef89f04eed9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:31.228349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-15535043-7468-4339-adfa-fef89f04eed9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:31.237534 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-15535043-7468-4339-adfa-fef89f04eed9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1242 microversion: 2.1 time: 0.083001 Oct 23 02:15:31.238109 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 232/458] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:31 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:31.581944 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:31.582578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:31.590079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:31.590593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:31.591030 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:31.591728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:31.592177 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:31.592596 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:31.733812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:31.744254 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:31.745840 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:31.747046 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7c1d0bfc-b86e-4032-af35-2fd2f8bd38a5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.169793 Oct 23 02:15:31.747607 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 227/459] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:31 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:32.261973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:32.262692 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:32.268960 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:32.269606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:32.270026 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:32.270757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:32.271290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:32.271741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:32.344377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:32.352679 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9ea7304e-9320-4f76-ba1a-4692ee7ff865 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.095221 Oct 23 02:15:32.353258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 233/460] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:32 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:32.773902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:32.774726 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:32.781850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:32.782337 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:32.782818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:32.783783 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:32.784241 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:32.784670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:32.923350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:32.932368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:32.933800 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:32.934982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a91b61a4-ffe4-453f-b3d4-af3e1224d50f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.166189 Oct 23 02:15:32.935552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 228/461] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:32 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:33.376105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:33.376709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:33.382614 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:33.383653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:33.384089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:33.384770 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:33.385214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:33.385636 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:33.448654 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:33.456626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-00026675-bcef-461f-a96a-7af6cd7cdc73 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.084391 Oct 23 02:15:33.457203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 234/462] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:33 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:33.960571 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:33.961463 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:33.967745 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:33.968228 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:33.968666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:33.969360 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:33.969822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:33.970242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:33.972970 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:34.110417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:34.119646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:34.121081 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:34.122462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ce2e366f-d58c-49e2-8396-dda987e6d869 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.166100 Oct 23 02:15:34.123060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 229/463] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:33 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:34.480521 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:34.481166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:34.487409 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:34.487890 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:34.488314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:34.489002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:34.489448 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:34.489863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:34.493295 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:34.555710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:34.563692 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9a863c0f-db11-465c-9c80-3002c2b66edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.087852 Oct 23 02:15:34.564273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 235/464] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:34 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:35.147481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:35.148094 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:35.155216 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:35.155707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:35.156135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:35.156826 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:35.157273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:35.157696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:35.293142 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:35.301843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:35.303304 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:35.304452 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-638d09a3-07cf-4fa5-85a4-a4190542d1ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.161049 Oct 23 02:15:35.305009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 230/465] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:35 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:35.585775 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:35.586496 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:35.592652 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:35.593127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:35.593560 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:35.594248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:35.594727 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:35.595145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:35.658367 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:35.666592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-825bd0a9-3634-4dbf-a2c8-550bc46abb2c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.084617 Oct 23 02:15:35.667171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 236/466] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:35 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:36.331180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:36.331794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:36.338968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:36.339454 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:36.339887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:36.340598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:36.341034 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:36.341454 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:36.481737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:36.491147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:36.493543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:36.495162 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a56bd70d-f023-4da1-8003-4051f768bced tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.167852 Oct 23 02:15:36.495793 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 231/467] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:36 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:15:36.693752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:36.694370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:36.701375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:36.701863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:36.702293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:36.703051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:36.703498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:36.703917 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:36.768201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:36.776772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0a74b029-5fe4-41ed-b618-12f6787090ae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.091124 Oct 23 02:15:36.777373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 237/468] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:36 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:37.520903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:37.521519 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:37.529623 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:37.530430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:37.531324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:37.532324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:37.532847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:37.533697 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:37.670970 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:37.680155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:37.682878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:37.684057 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2ce53cd9-2922-46bd-b406-30cf81695a50 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.167177 Oct 23 02:15:37.686485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 232/469] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:37 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:37.801110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:37.801712 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:37.808843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:37.809324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:37.809749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:37.810426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:37.810894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:37.811312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:37.874812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:37.884186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a5acaa7d-f6c3-4b5d-a245-4d999fc519b9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.086198 Oct 23 02:15:37.884982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 238/470] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:37 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:38.709055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:38.709642 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:38.717028 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:38.717513 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:38.717948 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:38.718772 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:38.719134 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:38.719562 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:38.854468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:38.864278 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:38.865895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:38.867097 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3ca4a8c9-56b8-44ee-8a7f-e4acad82aee9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.161915 Oct 23 02:15:38.867665 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 233/471] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:38 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:38.909058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:38.911062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:38.917076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:38.917550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:38.918147 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:38.919211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:38.919313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:38.919707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:38.984831 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:38.992480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-440c09bc-12f6-445b-8a27-2ee746820811 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.088060 Oct 23 02:15:38.993226 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 239/472] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:38 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:39.894796 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:39.895412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:39.902262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:39.903187 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:39.903624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:39.904475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:39.904951 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:39.905375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:40.017121 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:40.019140 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:40.025849 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:40.026664 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:40.027281 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:40.028140 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:40.028759 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:40.029181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:40.044511 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:40.053681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:40.055614 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:40.057554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-75dd3dae-6ae0-413c-a891-8b0935dbae30 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.167447 Oct 23 02:15:40.058192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 234/473] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:39 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:40.098221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:40.106983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-151b694d-4390-4663-93f7-448e56221d76 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.094298 Oct 23 02:15:40.109025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 240/474] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:40 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:41.084224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:41.084915 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:41.088587 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:41.089484 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=6 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:41.095379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:41.095864 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:41.096295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:41.096989 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:41.097438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:41.097868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:41.130512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:41.131131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:41.138474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:41.139324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:41.139992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:41.140913 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:41.141590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:41.142088 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:41.223741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:41.232048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3a88b4ec-e76d-42e5-ad5b-c88c6cd61406 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.105237 Oct 23 02:15:41.232633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 241/475] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:41 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:15:41.284192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:41.294578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:41.296021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:41.297520 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cff90ebf-d663-4ad7-a9e9-1e79ebd0db80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.217307 Oct 23 02:15:41.297926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 235/476] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:41 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:42.254647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:42.255311 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:42.257223 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=6 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:42.263058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:42.263542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:42.263974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:42.264705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:42.265156 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:42.265579 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:42.324051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:42.324645 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:42.330631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:42.331122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:42.331556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:42.332446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:42.332903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:42.333327 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:42.349062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:42.357387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1c3f5328-b478-4091-b188-2a2472d9ae5a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.106637 Oct 23 02:15:42.357959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 242/477] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:42 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:42.466154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:42.474798 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:42.476232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:42.477406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9fae37d2-7d1c-4751-bf2a-2df2a1557694 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.158137 Oct 23 02:15:42.477992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 236/478] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:42 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:15:43.380055 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:43.380660 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:43.387208 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:43.387676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:43.388100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:43.388769 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:43.389215 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:43.389628 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:43.452555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:43.460080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f911d1c7-5a1f-4f6b-a71e-73196108645b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.083849 Oct 23 02:15:43.460630 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 243/479] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:43 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:43.502680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:43.503289 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:43.510654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:43.511135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:43.511566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:43.512248 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:43.512719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:43.513141 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:43.642124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:43.650867 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:43.652312 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:43.653458 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e2a6d504-09a3-4370-bebe-4de38daf7b9d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.154640 Oct 23 02:15:43.654019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 237/480] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:43 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:44.483585 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:44.484156 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:44.490043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:44.490620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:44.491054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:44.491732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:44.492182 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:44.492602 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:44.552381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:44.559999 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-76c92dc3-db32-4b93-bcf2-871afff4e518 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.080269 Oct 23 02:15:44.560564 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 244/481] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:44 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:44.678843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:44.679452 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:44.687218 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:44.687218 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:44.687576 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:44.688271 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:44.688723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:44.689146 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:44.816521 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:44.827053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:44.828479 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:44.829616 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-91778891-c58a-4b7a-938e-0823d8b0de82 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.154593 Oct 23 02:15:44.830171 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 238/482] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:44 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:45.583085 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:45.583694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:45.589728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:45.590220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:45.590670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:45.591349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:45.591798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:45.592223 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:45.653034 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:45.660822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-fb683c35-2709-42c5-a52e-ed3be7b8675f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.081581 Oct 23 02:15:45.661390 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 245/483] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:45 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:15:45.855079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:45.855757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:45.862168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:45.862698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:45.863138 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:45.863833 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:45.864296 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:45.864718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:45.991581 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:46.000560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:46.002050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:46.003237 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0f297abb-947f-46f6-9a0d-a8818fd0f27c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.152308 Oct 23 02:15:46.003807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 239/484] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:45 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:46.684529 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:46.685200 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:46.691133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:46.691610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:46.692035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:46.692716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:46.693164 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:46.693581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:46.756078 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:46.764384 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-23c08a76-1ea8-487e-848d-02f765faef56 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1246 microversion: 2.1 time: 0.084280 Oct 23 02:15:46.764952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 246/485] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:46 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:47.028353 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:47.028952 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:47.035486 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:47.035961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:47.036392 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:47.037075 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:47.037522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:47.037940 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:47.167071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:47.175788 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:47.177287 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:47.178454 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f5a35826-7fb5-4043-afb0-e70701df061f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.153965 Oct 23 02:15:47.179029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 240/486] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:47 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:47.786947 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:47.787556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:47.796038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:47.796497 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:47.796933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:47.797625 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:47.798073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:47.798699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:47.867581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:47.875929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-99c6882d-f7cf-4015-86fa-f1caf601d656 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1294 microversion: 2.1 time: 0.092670 Oct 23 02:15:47.876509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 247/487] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:47 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:48.204556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:48.205222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:48.211618 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:48.212095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:48.212526 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:48.213207 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:48.213654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:48.214078 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:48.347232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:48.356183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:48.357195 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:48.358394 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8c9576db-1c25-4877-97e1-aec7a8831435 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.157785 Oct 23 02:15:48.358983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 241/488] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:48 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:48.899393 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:48.899999 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:48.906559 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:48.907047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:48.907736 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:48.908423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:48.908874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:48.909299 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:48.995267 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:49.003086 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e2b3b092-ce29-4316-927c-91bdec6a889b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1300 microversion: 2.1 time: 0.107542 Oct 23 02:15:49.003847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 248/489] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:48 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:49.387442 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:49.388106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:49.395018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:49.395513 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:49.395953 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:49.396666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:49.397176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:49.397606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:49.636883 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:49.646424 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:49.647886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:49.649076 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b65393bf-eda9-4e3b-8d33-3cecd7debdcc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.266611 Oct 23 02:15:49.649639 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 242/490] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:49 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:50.026769 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:50.027883 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:50.037337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:50.037871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:50.038303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:50.039196 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:50.039644 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:50.040201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:50.277250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:50.285642 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-721e5b04-128d-41fc-9156-bb5c9a89c24f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.263517 Oct 23 02:15:50.286255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 249/491] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:50 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:50.420288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-3afeab7e-bb31-4b6c-9c96-bb3a6eee2045 req-c6352b02-2d3c-4228-a8c1-c6618311e7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc846d9-9f7a-4a4a-a027-4117c043b0e5", "tag": "853b17f0-ba1e-401a-9632-0f158dc66a3e"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:50.431060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-3afeab7e-bb31-4b6c-9c96-bb3a6eee2045 req-c6352b02-2d3c-4228-a8c1-c6618311e7c8 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:50.431690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-3afeab7e-bb31-4b6c-9c96-bb3a6eee2045 req-c6352b02-2d3c-4228-a8c1-c6618311e7c8 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:50.432520 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-3afeab7e-bb31-4b6c-9c96-bb3a6eee2045 req-c6352b02-2d3c-4228-a8c1-c6618311e7c8 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:50.443757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-3afeab7e-bb31-4b6c-9c96-bb3a6eee2045 req-c6352b02-2d3c-4228-a8c1-c6618311e7c8 service nova] Creating event network-changed:853b17f0-ba1e-401a-9632-0f158dc66a3e for instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 on hv-cinder-86149 Oct 23 02:15:50.448946 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-3afeab7e-bb31-4b6c-9c96-bb3a6eee2045 req-c6352b02-2d3c-4228-a8c1-c6618311e7c8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033145 Oct 23 02:15:50.449538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 243/492] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:15:50.675552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:50.676158 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:50.682981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:50.683489 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:50.686181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:50.686181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:50.686181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:50.686181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:50.892613 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:50.901886 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:50.903397 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:50.904606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-43c261d6-e2a7-4a23-bfcd-b93cb0d849d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.232891 Oct 23 02:15:50.905377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 250/493] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:50 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:51.310898 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:51.311739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:51.313645 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:51.319036 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:51.319521 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:51.319961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:51.320651 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:51.321105 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:51.321557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:51.468401 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:51.476099 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a866f014-423b-460e-b779-766ac0a37659 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.170537 Oct 23 02:15:51.476667 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 244/494] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:51 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:51.930381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:51.930987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:51.937534 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:51.937952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:51.938382 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:51.939082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:51.939529 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:51.939943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:52.068598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:52.070764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:52.078276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:52.079730 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:52.080869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7a65fa32-711a-43a1-9e73-5f8e32e30c7e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.154376 Oct 23 02:15:52.081417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 251/495] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:51 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:52.499969 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:52.500573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:52.506880 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:52.507359 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:52.507788 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:52.508477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:52.508921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:52.510555 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:52.638524 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:52.646133 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7077801b-db5f-44a3-91e8-a51beecdbb27 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.150066 Oct 23 02:15:52.646734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 245/496] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:52 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:53.107580 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:53.108109 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:53.113992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:53.114500 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:53.114934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:53.115614 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:53.116067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:53.116485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:53.246134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:53.255428 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:53.256853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:53.257992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2c004630-dab1-424e-a5e8-9a723c7051c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.155351 Oct 23 02:15:53.258575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 252/497] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:53 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:53.669668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:53.670208 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:53.676632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:53.677111 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:53.677547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:53.678233 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:53.678727 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:53.679157 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:53.694011 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:53.806262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:53.813768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-37d2fc3d-2698-4ecf-8e1e-74f5f88de708 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.148176 Oct 23 02:15:53.814337 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 246/498] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:53 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:54.284720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:54.285320 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:54.291433 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:54.291856 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:54.292286 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:54.292963 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:54.293414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:54.293832 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:54.427246 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:54.436653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:54.438083 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:54.439262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5f13d3e4-19f9-41e0-874d-cf32fa993224 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.158728 Oct 23 02:15:54.439825 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 253/499] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:54 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:54.836836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:54.838370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:54.844738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:54.845214 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:54.845643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:54.846321 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:54.846796 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:54.847218 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:54.975219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:54.983865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-889b2b03-7126-4ba5-8bcd-5449c8e6446d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.150931 Oct 23 02:15:54.984427 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 247/500] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:54 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:55.466109 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:55.466850 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:55.472772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:55.473333 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:55.474001 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:55.475033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:55.475487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:55.476765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:55.609695 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:55.618757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:55.620348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:55.621498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-111f01b8-0bf3-4b9c-9c73-9091240edca1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.160223 Oct 23 02:15:55.622055 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 254/501] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:55 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:56.007055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:56.007897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:56.015239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:56.015541 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:56.016088 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:56.016780 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:56.017410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:56.017923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:56.153243 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7edc12d2-1dce-467e-af02-bc36dcd5c58e"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:56.156329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:56.162808 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:56.163649 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:56.164265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:56.165225 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:56.165973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:56.166395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:56.219803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:56.228777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-11c9ef6a-0c75-4470-bc6b-a7a00c8ed95f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.225827 Oct 23 02:15:56.229491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 248/502] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:56 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:56.476237 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2c69413b-9bf1-44f5-9e19-6b6656bd83a3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327688 Oct 23 02:15:56.477127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 255/503] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:15:56 2022] POST /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:15:56.645979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:56.646636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:56.653230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:56.653729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:56.654159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:56.654886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:56.655341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:56.655789 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:56.788054 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:56.797425 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:56.798882 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:56.800015 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b615e0f8-7af7-4cd0-8037-40a8ce8273f3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.157891 Oct 23 02:15:56.800566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 249/504] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:56 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:57.252641 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:57.253359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:57.260602 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:57.261080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:57.261508 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:57.262183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:57.262653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:57.263067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:57.397565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:57.407826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cfd5d4ae-ed43-4fb0-a367-d844ea50709f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.159376 Oct 23 02:15:57.408395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 256/505] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:57 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:57.713534 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-99a494e5-f826-40f8-994c-2f372809dfb6 req-8e377fc6-23c2-4599-b537-7ed941f2046e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc846d9-9f7a-4a4a-a027-4117c043b0e5", "name": "network-vif-plugged", "status": "completed", "tag": "853b17f0-ba1e-401a-9632-0f158dc66a3e"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:57.723797 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-99a494e5-f826-40f8-994c-2f372809dfb6 req-8e377fc6-23c2-4599-b537-7ed941f2046e service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:57.724285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-99a494e5-f826-40f8-994c-2f372809dfb6 req-8e377fc6-23c2-4599-b537-7ed941f2046e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:57.724724 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-99a494e5-f826-40f8-994c-2f372809dfb6 req-8e377fc6-23c2-4599-b537-7ed941f2046e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:57.736606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-99a494e5-f826-40f8-994c-2f372809dfb6 req-8e377fc6-23c2-4599-b537-7ed941f2046e service nova] Creating event network-vif-plugged:853b17f0-ba1e-401a-9632-0f158dc66a3e for instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 on hv-cinder-86149 Oct 23 02:15:57.741885 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-99a494e5-f826-40f8-994c-2f372809dfb6 req-8e377fc6-23c2-4599-b537-7ed941f2046e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033107 Oct 23 02:15:57.742513 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 250/506] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:15:57.825929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:57.826663 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:57.833228 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:57.834018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:57.834646 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:57.835410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:57.835925 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:57.836409 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:57.977381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:57.988145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:57.989239 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:57.990968 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-307f1cd7-56d3-407d-8147-139ef34e664a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.169579 Oct 23 02:15:57.991961 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 257/507] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:57 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:58.432731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:58.433528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:58.439778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:58.440257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:58.440909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:58.441602 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:58.442052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:58.442561 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:58.575148 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:58.582721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6f52f1db-483d-4702-ad71-1fed8fd96a6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.154974 Oct 23 02:15:58.583232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 251/508] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:58 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:59.017166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:59.017767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:59.020252 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:15:59.027024 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:59.027506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:59.027933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:59.028609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:59.029051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:59.029474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:59.158415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:59.167607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:59.169046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:59.170195 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-60c29622-48de-421f-9ca9-71ed98779d77 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.156929 Oct 23 02:15:59.170794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 258/509] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:15:59 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:15:59.606552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:15:59.607178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:15:59.613556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:59.614037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:59.614499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:59.615190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:59.615640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:59.616064 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:59.758136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:15:59.766519 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7e6a58ba-c76c-4340-aa6f-94fd523701f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1368 microversion: 2.1 time: 0.164481 Oct 23 02:15:59.767097 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 252/510] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:15:59 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:15:59.821304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-d9390887-8973-4008-8efd-cd4bcf8aca9e req-1e8e1d5a-c405-436e-93ae-ba0c37ec17a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847628be-0620-4309-99c8-6036d43d26f7", "name": "network-vif-plugged", "status": "completed", "tag": "24fbd91b-949f-4c46-a496-148c4722eb45"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:15:59.831427 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d9390887-8973-4008-8efd-cd4bcf8aca9e req-1e8e1d5a-c405-436e-93ae-ba0c37ec17a7 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:15:59.831895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d9390887-8973-4008-8efd-cd4bcf8aca9e req-1e8e1d5a-c405-436e-93ae-ba0c37ec17a7 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:15:59.832319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-d9390887-8973-4008-8efd-cd4bcf8aca9e req-1e8e1d5a-c405-436e-93ae-ba0c37ec17a7 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:15:59.843981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-d9390887-8973-4008-8efd-cd4bcf8aca9e req-1e8e1d5a-c405-436e-93ae-ba0c37ec17a7 service nova] Creating event network-vif-plugged:24fbd91b-949f-4c46-a496-148c4722eb45 for instance 847628be-0620-4309-99c8-6036d43d26f7 on hv-cinder-86149 Oct 23 02:15:59.848958 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-d9390887-8973-4008-8efd-cd4bcf8aca9e req-1e8e1d5a-c405-436e-93ae-ba0c37ec17a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031422 Oct 23 02:15:59.849541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 259/511] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:16:00.196617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:00.197230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:00.203325 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:00.203813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:00.204275 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:00.205007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:00.205487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:00.205938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:00.334886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:00.344184 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:00.345713 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:00.346964 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ef6cfc8b-0845-4f35-8690-842674aa35cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.154333 Oct 23 02:16:00.347559 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 253/512] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:16:00 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:16:00.789865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:00.790583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:00.797097 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:00.797574 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:00.798001 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:00.798706 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:00.799155 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:00.799572 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:00.931909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:00.939826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-27df6efe-2411-4475-b351-37257aa6d679 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1559 microversion: 2.1 time: 0.154078 Oct 23 02:16:00.940329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 260/513] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:00 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:00.964682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:00.965401 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:00.972059 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:00.972542 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:00.972983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:00.973683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:00.974140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:00.974603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:01.051896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-28e6fd12-aa27-435e-a064-1f41ef5a155c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091229 Oct 23 02:16:01.052592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 254/514] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 23 02:16:00 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:16:01.375384 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:01.375981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:01.382181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:01.382567 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:01.383078 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:01.383937 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:01.384394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:01.384823 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:01.621075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:01.629580 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:01.631058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:01.632209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-96022034-981b-4a66-bc96-63bdab8ae3cc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.261023 Oct 23 02:16:01.632789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 261/515] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:16:01 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:16:02.354517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-b00bccd8-4d2e-48e5-9574-7fd82280ae01 req-679d6b79-9087-4ef8-ab22-b9d1ced0a64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc846d9-9f7a-4a4a-a027-4117c043b0e5", "tag": "853b17f0-ba1e-401a-9632-0f158dc66a3e"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:02.364487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b00bccd8-4d2e-48e5-9574-7fd82280ae01 req-679d6b79-9087-4ef8-ab22-b9d1ced0a64c service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:02.364961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b00bccd8-4d2e-48e5-9574-7fd82280ae01 req-679d6b79-9087-4ef8-ab22-b9d1ced0a64c service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:02.365384 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b00bccd8-4d2e-48e5-9574-7fd82280ae01 req-679d6b79-9087-4ef8-ab22-b9d1ced0a64c service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:02.377532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-b00bccd8-4d2e-48e5-9574-7fd82280ae01 req-679d6b79-9087-4ef8-ab22-b9d1ced0a64c service nova] Creating event network-changed:853b17f0-ba1e-401a-9632-0f158dc66a3e for instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 on hv-cinder-86149 Oct 23 02:16:02.382648 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-b00bccd8-4d2e-48e5-9574-7fd82280ae01 req-679d6b79-9087-4ef8-ab22-b9d1ced0a64c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033014 Oct 23 02:16:02.383846 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 255/516] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:16:02.658483 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:02.659095 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:02.665510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:02.665992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:02.666430 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:02.667143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:02.667594 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:02.668025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:02.808808 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:02.817607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:02.819076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:02.820233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ed089a83-391b-4e1a-ba1d-31e20307aa89 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.166002 Oct 23 02:16:02.821989 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 262/517] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:16:02 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:16:03.848822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:03.849664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:03.856304 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:03.856942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:03.857218 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:03.857912 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:03.858504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:03.858811 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:04.002655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:04.013923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:04.015382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:04.016536 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-03163b28-50f8-4bb7-8296-feeec0290792 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1808 microversion: 2.20 time: 0.172403 Oct 23 02:16:04.017098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 256/518] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:16:03 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:16:05.043046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:05.044235 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:05.051057 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:05.051549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:05.051984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:05.052699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:05.053137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:05.053563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:05.105239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:05.107646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:05.114377 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:05.114907 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:05.115462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:05.116178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:05.116637 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:05.117071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:05.140401 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lazy-loading 'flavor' on Instance uuid 91fc5747-8451-4657-979e-570ad7e73b8b {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:16:05.255477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:05.266152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:05.268116 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:05.268909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5aab8ad1-f8a5-48bc-b759-45aa4e243f3a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/action" status: 200 len: 32 microversion: 2.1 time: 0.167329 Oct 23 02:16:05.269332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 257/519] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:16:05 2022] POST /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 02:16:05.269805 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-750e6dbe-e1cd-437a-8982-ed7f828764c0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1795 microversion: 2.20 time: 0.231161 Oct 23 02:16:05.270473 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 263/520] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:16:05 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1795 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:16:05.279301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:05.280005 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:05.286557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:05.287102 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:05.287599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:05.288359 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:05.288816 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:05.289243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:05.506862 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:05.516039 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c01a43af-525c-412c-8797-80e04a062ad3 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.240920 Oct 23 02:16:05.516690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 258/521] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:05 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:06.538975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:06.539612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:06.546886 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:06.547382 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:06.547820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:06.548530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:06.548985 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:06.549555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:06.680378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:06.689576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-de807232-6c74-46c5-9978-fae15dc6d885 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.154379 Oct 23 02:16:06.690201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 264/522] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:06 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:07.712631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:07.713261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:07.719883 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:07.720370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:07.720808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:07.721531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:07.722004 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:07.722431 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:07.860590 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:07.869197 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-57287949-564a-4d77-a352-a4126f819e18 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.161141 Oct 23 02:16:07.869765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 259/523] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:07 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:08.893128 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:08.893784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:08.901209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:08.901685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:08.902121 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:08.902827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:08.903279 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:08.903697 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:09.033726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:09.042002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5ffd002a-fce3-4518-bbaa-98ead082cd03 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.152757 Oct 23 02:16:09.042578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 265/524] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:08 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:10.065582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:10.066136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:10.072978 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:10.073457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:10.073887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:10.074597 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:10.075048 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:10.075469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:10.208396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:10.217058 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-426acf04-e969-4af6-a376-02e6492e388d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.155425 Oct 23 02:16:10.217598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 260/525] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:10 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:11.240332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:11.240992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:11.247449 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:11.247927 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:11.248362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:11.249040 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:11.249485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:11.249905 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:11.375838 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:11.384052 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e245cf7f-28c7-4788-ad39-07c539a8b7f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.147675 Oct 23 02:16:11.384638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 266/526] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:11 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:12.408521 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:12.409136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:12.416415 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:12.416903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:12.417348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:12.418049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:12.418548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:12.418989 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:12.553553 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:12.563444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-741a9d23-4f0a-4328-91bd-c088de7450a7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.158967 Oct 23 02:16:12.564354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 261/527] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:12 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:13.587853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:13.588458 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:13.595016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:13.595498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:13.595931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:13.596610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:13.597063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:13.597484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:13.732487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:13.734765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:13.742205 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-44f19fe3-dc8e-4857-ad45-5c4265df1845 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.158794 Oct 23 02:16:13.743308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 267/528] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:13 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:14.765345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:14.765959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:14.772407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:14.772893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:14.773334 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:14.774523 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:14.774700 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:14.775128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:14.902160 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:14.904470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:14.912776 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-aca33a70-ec04-4bac-b1a7-4bb3e3511271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.151271 Oct 23 02:16:14.913351 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 262/529] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:14 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:15.936415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:15.937014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:15.944296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:15.944771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:15.945198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:15.946366 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:15.946846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:15.947268 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:16.135921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:16.144130 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-77d6690f-4c1f-49bf-b73f-14c45787cc5c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.211884 Oct 23 02:16:16.144698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 268/530] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:15 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:17.169173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:17.169818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:17.176872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:17.177357 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:17.177809 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:17.178509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:17.178966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:17.179393 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:17.359061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:17.367187 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c6abe559-282b-4301-9e1e-ef66c4d7296d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.202400 Oct 23 02:16:17.367753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 263/531] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:17 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:18.389241 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:18.389840 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:18.396179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:18.396653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:18.397087 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:18.397762 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:18.398205 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:18.398656 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:18.531063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:18.539118 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6f382c21-c608-4b88-9d82-4f494ad5d467 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.153754 Oct 23 02:16:18.539678 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 269/532] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:18 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:19.562902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:19.563517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:19.569944 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:19.570423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:19.570894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:19.572246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:19.572885 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:19.573318 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:19.702213 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:19.710396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-58b719da-1e49-4ae6-bc1d-4140cac55da5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.151520 Oct 23 02:16:19.711350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 264/533] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:19 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:20.733231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:20.733838 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:20.740325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:20.740801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:20.741240 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:20.741915 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:20.742368 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:20.742819 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:20.873864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:20.881974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8295a2e3-5d88-4cd7-b124-57bec4360981 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.152594 Oct 23 02:16:20.882565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 270/534] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:20 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:16:21.906543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:21.907156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:21.909037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=42 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:21.914306 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:21.915538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:21.916086 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:21.916777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:21.917230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:21.917660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:22.044414 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:22.052669 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ab300ac7-0b2a-4fdf-ad79-56c7bc24ff29 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.150446 Oct 23 02:16:22.053242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 265/535] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:21 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:23.075709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:23.076273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:23.082653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:23.083135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:23.083574 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:23.084258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:23.084709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:23.085130 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:23.131680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:23.132262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:23.134705 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:16:23.134842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Sun Oct 23 02:16:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-volume_attachments/b3e9ebd2-ad9a-427f-b14c-37437a1aec01 (ip 10.222.0.23) !!! Oct 23 02:16:23.148148 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:23.148640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:23.149138 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:23.149839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:23.150297 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:23.150768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:23.214400 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:23.222517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c3b6c2c1-a262-4500-be18-48ce1dfd74f6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.150675 Oct 23 02:16:23.223088 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 271/536] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:23 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:23.280733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lazy-loading 'services' on Instance uuid 973e0362-0459-4084-9f53-776ba26a7fbf {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:16:23.394668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-eddcf46a-c3a7-4d3d-a18e-3b27f69d65d6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-volume_attachments/b3e9ebd2-ad9a-427f-b14c-37437a1aec01" status: 202 len: 0 microversion: 2.1 time: 0.266789 Oct 23 02:16:23.395270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 266/537] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:16:23 2022] DELETE /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-volume_attachments/b3e9ebd2-ad9a-427f-b14c-37437a1aec01 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:16:24.246231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:24.246862 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:24.253286 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:24.253757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:24.254202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:24.254894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:24.255385 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:24.255801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:24.388072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:24.396197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c2e4ed4b-1e73-4f6e-9440-c0f1b8aee914 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.153840 Oct 23 02:16:24.396757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 272/538] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:24 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:25.421206 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:25.421932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:25.428674 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:25.429159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:25.429597 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:25.430912 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:25.431375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:25.431808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:25.594603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-85179430-1927-4b2a-b39f-4309cab62bff tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:25.600872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-85179430-1927-4b2a-b39f-4309cab62bff tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:25.601339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-85179430-1927-4b2a-b39f-4309cab62bff tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:25.601790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-85179430-1927-4b2a-b39f-4309cab62bff tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:25.615507 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:25.624554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0c960661-147d-43af-9961-f65a408626ad tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1735 microversion: 2.1 time: 0.208105 Oct 23 02:16:25.625220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 267/539] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:25 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:25.665517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-85179430-1927-4b2a-b39f-4309cab62bff tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Going to try to stop instance {{(pid=118877) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 23 02:16:25.710997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-85179430-1927-4b2a-b39f-4309cab62bff tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/action" status: 202 len: 0 microversion: 2.1 time: 0.120028 Oct 23 02:16:25.712188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 273/540] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:16:25 2022] POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:16:25.720839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:25.721467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:25.728756 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:25.729246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:25.729676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:25.730374 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:25.730859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:25.731281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:25.863718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:25.872665 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-03bef7f0-294d-4830-aed9-354d41717386 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.156045 Oct 23 02:16:25.873235 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 268/541] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:25 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:26.650453 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:26.651185 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:26.657488 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:26.657965 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:26.658402 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:26.659104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:26.659556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:26.659978 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:26.791487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:26.799793 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-192d0205-ef2d-4c9e-860b-f1b1e2e1725b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1715 microversion: 2.1 time: 0.154883 Oct 23 02:16:26.800307 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 274/542] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:26 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:26.896093 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:26.896699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:26.904810 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:26.905295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:26.905847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:26.906582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:26.907072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:26.907499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:26.909110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:26.909609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:26.915931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:26.916413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:26.916852 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:26.917540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:26.917992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:26.918415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:27.036662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:27.044292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a8ad0258-c30a-4b70-a528-3ffa2ca348f2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.152031 Oct 23 02:16:27.044850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 269/543] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:26 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:27.047794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] HTTP exception thrown: Cannot 'detach_volume' instance 91fc5747-8451-4657-979e-570ad7e73b8b while it is in vm_state rescued Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Request method failure captured: Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments/7edc12d2-1dce-467e-af02-bc36dcd5c58e HTTP/1.1 Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLTOhI2m3mC7wlIqd4CYp_smt7j-uUYTHtphx3tpP-_pKnVPURgJoWW71reomIvkE2qFOSd-STCx1RUAT7e40Y1Ze6pHTvgD4ydMa-n6L3tJdeVRqrwiep-_GtviydtY9KdggIAflNA-tUJ8-6E384vIlw5sc3c_rNbZyiToR1MqDc Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:16:27.050191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 2335878ea1d045858b158f6b4175e896 Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:16:27.051817 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Cannot 'detach_volume' instance 91fc5747-8451-4657-979e-570ad7e73b8b while it is in vm_state rescued Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'server_id': '91fc5747-8451-4657-979e-570ad7e73b8b', 'id': '7edc12d2-1dce-467e-af02-bc36dcd5c58e'} Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91fc5747-8451-4657-979e-570ad7e73b8b in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:16:27.056423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 91fc5747-8451-4657-979e-570ad7e73b8b while it is in vm_state rescued Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 91fc5747-8451-4657-979e-570ad7e73b8b while it is in vm_state rescued Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:16:27.057914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Returning 409 to user: Cannot 'detach_volume' instance 91fc5747-8451-4657-979e-570ad7e73b8b while it is in vm_state rescued {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:16:27.059141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b07342ba-5c1c-494b-bed5-64de52e6c29d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments/7edc12d2-1dce-467e-af02-bc36dcd5c58e" status: 409 len: 152 microversion: 2.1 time: 0.146508 Oct 23 02:16:27.059141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 275/544] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:16:26 2022] DELETE /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments/7edc12d2-1dce-467e-af02-bc36dcd5c58e => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 23 02:16:27.065759 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:27.066295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:27.072863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:27.073343 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:27.073780 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:27.074497 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:27.074955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:27.075378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:27.141497 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bef78f2b-ed66-4de0-8761-1c22c10276f0 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "POST /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/action" status: 202 len: 0 microversion: 2.1 time: 0.079317 Oct 23 02:16:27.143982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 270/545] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:16:27 2022] POST /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:16:27.151733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:27.152477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:27.160379 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:27.160989 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:27.161468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:27.162655 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:27.163189 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:27.163688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:27.299956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:27.308800 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-46d53d32-783c-4bfb-9756-f9076495c3de tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1723 microversion: 2.1 time: 0.162160 Oct 23 02:16:27.309314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 276/546] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:27 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:28.175834 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:28.176555 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:28.183342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:28.183821 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:28.184255 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:28.184935 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:28.185383 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:28.185804 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:28.317161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:28.325296 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6d42231f-1aab-4ec5-b7bc-d2603d01d9e8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.260562 Oct 23 02:16:28.325871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 271/547] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:28 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:28.332630 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:28.333343 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:28.340256 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:28.340729 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:28.341207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:28.341859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:28.342306 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:28.342753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:28.470967 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:28.480238 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c6115a01-2989-4960-b584-0c4c73798612 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1723 microversion: 2.1 time: 0.151364 Oct 23 02:16:28.480793 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 277/548] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:28 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:29.348599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:29.349206 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:29.356094 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:29.356574 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:29.357006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:29.357691 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:29.358137 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:29.358587 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:29.491659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:29.500290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a00aa814-75ec-4d47-abd0-1e3b1d71ac19 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.155536 Oct 23 02:16:29.500858 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 272/549] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:29 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:29.502879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:29.503489 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:29.506704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:16:29.506853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Sun Oct 23 02:16:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b (ip 10.222.0.23) !!! Oct 23 02:16:29.508974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=40 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:29.516059 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:29.516577 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:29.517041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:29.517771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:29.518230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:29.518685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:29.644997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:29.654452 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-36262df5-c0c1-49c6-bce6-7216a30da249 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1723 microversion: 2.1 time: 0.155218 Oct 23 02:16:29.655018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 278/550] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:29 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:16:30.524887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:30.525501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:30.532213 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:30.532694 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:30.533131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:30.533823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:30.534279 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:30.534739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:30.666292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:30.673901 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c7fbea49-0a4f-46ee-8693-a2a83e8d646e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.153023 Oct 23 02:16:30.674647 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 273/551] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:30 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:30.678378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:30.679026 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:30.687358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:30.687865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:30.688313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:30.689040 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:30.689444 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:30.689869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:30.821066 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:30.829266 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0c964515-51f8-4e47-b859-62ec8e11c879 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1723 microversion: 2.1 time: 0.155053 Oct 23 02:16:30.829821 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 279/552] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:30 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:16:31.698492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:31.699117 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:31.705532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:31.706014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:31.706475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:31.707158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:31.707610 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:31.708034 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:31.840982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:31.849716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ba82858d-98e5-4dec-91f9-e88740647401 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.155494 Oct 23 02:16:31.861616 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 274/553] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:31 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:31.861828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:31.861828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:31.861828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:31.861828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:31.862520 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:31.862520 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:31.862709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:31.863094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:31.994228 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:32.002378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2e6fc144-0569-469e-a2a5-7c5ea027659d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1729 microversion: 2.1 time: 0.153075 Oct 23 02:16:32.002965 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 280/554] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:31 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:32.025815 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:32.026309 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:32.032557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:32.033041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:32.033476 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:32.034166 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:32.034661 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:32.035090 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:32.110701 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e0cd066a-d9b5-4d1d-a9c0-ed1b5490c7ec tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088679 Oct 23 02:16:32.111323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 275/555] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 23 02:16:32 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:16:32.873262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:32.873939 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:32.880320 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:32.880801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:32.881232 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:32.881967 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:32.882988 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:32.883418 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:33.104498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:33.112050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c18290cb-a257-4440-bcaf-083000eda7a2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.242720 Oct 23 02:16:33.112880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 281/556] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:32 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:33.288551 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-8dc543a5-f0bd-4f5a-9a82-3d58d6c00f44 req-e2d1bad0-8a7d-4361-b841-28f2f7c39712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fc5747-8451-4657-979e-570ad7e73b8b", "tag": "91964ab3-6465-4503-be0d-3facc3db73f3"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:33.302370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8dc543a5-f0bd-4f5a-9a82-3d58d6c00f44 req-e2d1bad0-8a7d-4361-b841-28f2f7c39712 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:33.302887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8dc543a5-f0bd-4f5a-9a82-3d58d6c00f44 req-e2d1bad0-8a7d-4361-b841-28f2f7c39712 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:33.303329 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8dc543a5-f0bd-4f5a-9a82-3d58d6c00f44 req-e2d1bad0-8a7d-4361-b841-28f2f7c39712 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:33.315042 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-8dc543a5-f0bd-4f5a-9a82-3d58d6c00f44 req-e2d1bad0-8a7d-4361-b841-28f2f7c39712 service nova] Creating event network-changed:91964ab3-6465-4503-be0d-3facc3db73f3 for instance 91fc5747-8451-4657-979e-570ad7e73b8b on hv-cinder-86149 Oct 23 02:16:33.319850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-8dc543a5-f0bd-4f5a-9a82-3d58d6c00f44 req-e2d1bad0-8a7d-4361-b841-28f2f7c39712 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035026 Oct 23 02:16:33.321158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 276/557] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:16:34.137216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:34.137840 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:34.144273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:34.144746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:34.145172 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:34.145845 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:34.146300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:34.146738 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:34.276994 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:34.284835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3db319d4-c664-45c0-bc91-8a21e1d4c199 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.151620 Oct 23 02:16:34.285400 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 282/558] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:34 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:35.310631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:35.311345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:35.317395 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:35.317873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:35.318303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:35.319008 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:35.319461 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:35.321049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:35.334556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-1934ae81-6500-4ee1-a883-a47046802816 req-0716232c-bcbd-4b9d-a3b2-f7c8129627ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91fc5747-8451-4657-979e-570ad7e73b8b", "tag": "91964ab3-6465-4503-be0d-3facc3db73f3"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:35.344329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1934ae81-6500-4ee1-a883-a47046802816 req-0716232c-bcbd-4b9d-a3b2-f7c8129627ea service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:35.344796 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1934ae81-6500-4ee1-a883-a47046802816 req-0716232c-bcbd-4b9d-a3b2-f7c8129627ea service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:35.345220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-1934ae81-6500-4ee1-a883-a47046802816 req-0716232c-bcbd-4b9d-a3b2-f7c8129627ea service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:35.356146 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-1934ae81-6500-4ee1-a883-a47046802816 req-0716232c-bcbd-4b9d-a3b2-f7c8129627ea service nova] Creating event network-changed:91964ab3-6465-4503-be0d-3facc3db73f3 for instance 91fc5747-8451-4657-979e-570ad7e73b8b on hv-cinder-86149 Oct 23 02:16:35.361152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-1934ae81-6500-4ee1-a883-a47046802816 req-0716232c-bcbd-4b9d-a3b2-f7c8129627ea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030247 Oct 23 02:16:35.361739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 283/559] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:16:35.498295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:35.506040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cfeafa8b-5945-468e-a635-28ea84b45391 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.200158 Oct 23 02:16:35.506638 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 277/560] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:35 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:36.530460 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:36.531111 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:36.537145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:36.537624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:36.538054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:36.539301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:36.539749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:36.540168 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:36.542806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:36.671734 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:36.680257 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-631d090e-71c9-4e11-81b0-5118ba212d73 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.154821 Oct 23 02:16:36.681023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 284/561] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:36 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:37.703733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:37.704338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:37.711275 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:37.711750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:37.712185 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:37.712868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:37.713320 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:37.713734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:37.847301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:37.849561 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:16:37.856567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-aaa0af6d-d321-4dc2-98f0-d26ca394d261 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.156740 Oct 23 02:16:37.857130 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 278/562] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:37 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:38.879349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:38.879952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:38.886774 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:38.887251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:38.887687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:38.888363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:38.888815 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:38.889233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:39.020979 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:39.028907 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f77252f2-942e-4b20-81be-473d1bc3715f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.153220 Oct 23 02:16:39.029472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 285/563] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:38 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:40.053292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:40.054234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:40.061330 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:40.061810 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:40.062246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:40.062975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:40.063424 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:40.063847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:40.197461 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:40.205020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-52602faf-c75f-4ef4-87d7-47e00c20a1cb tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.155963 Oct 23 02:16:40.205591 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 279/564] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:40 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:41.229081 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:41.229722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:41.236445 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:41.236930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:41.237390 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:41.238110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:41.238596 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:41.239050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:41.367652 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:41.375309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2f46e4b2-d96e-4de1-accc-2d27a13e0a1f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1677 microversion: 2.1 time: 0.150377 Oct 23 02:16:41.375859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 286/565] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:41 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:42.399687 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:42.400292 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:42.406979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:42.407456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:42.407886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:42.408566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:42.409013 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:42.409430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:42.543158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:42.550681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0658bc23-7de8-411f-b87b-ec02f876384d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1654 microversion: 2.1 time: 0.155403 Oct 23 02:16:42.551276 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 280/566] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:42 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:42.574312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-41a720a0-da11-445d-b196-a842e89b394a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:16:42.580828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41a720a0-da11-445d-b196-a842e89b394a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:42.581306 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41a720a0-da11-445d-b196-a842e89b394a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:42.581733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-41a720a0-da11-445d-b196-a842e89b394a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:42.605095 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-41a720a0-da11-445d-b196-a842e89b394a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Going to try to start instance {{(pid=118877) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 23 02:16:42.645735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-41a720a0-da11-445d-b196-a842e89b394a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/action" status: 202 len: 0 microversion: 2.1 time: 0.075196 Oct 23 02:16:42.646309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 287/567] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:16:42 2022] POST /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:16:42.655016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:42.655560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:42.661933 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:42.663124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:42.663941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:42.664658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:42.665329 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:42.665848 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:42.809745 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:42.817490 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f8b9a2d0-fe72-4164-9f51-7f1fa62e8182 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1663 microversion: 2.1 time: 0.166708 Oct 23 02:16:42.818223 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 281/568] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:42 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:43.842556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:43.843246 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:43.849793 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:43.851305 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:43.851742 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:43.852423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:43.852870 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:43.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:43.984686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:43.992548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-450c5907-74c4-4e12-883c-b05f57db984c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1663 microversion: 2.1 time: 0.154325 Oct 23 02:16:43.993102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 288/569] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:43 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:16:45.017739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:16:45.018279 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:16:45.025793 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:45.026269 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:45.026727 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:45.027412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:16:45.027858 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:16:45.028541 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:16:45.158725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:16:45.167667 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a74d90a6-f9cd-493f-9021-6e8d46edf28f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1667 microversion: 2.1 time: 0.154036 Oct 23 02:16:45.168229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 282/570] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:16:45 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:11.791600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:11.792169 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:11.794597 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=21 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:11.795257 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:11.801315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:11.801943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:11.802381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:11.803110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:11.803570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:11.803991 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:11.829552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Going to try to terminate instance {{(pid=118877) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:11.904550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-caeaffdc-5eb1-4ce9-977a-607d3a988596 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 204 len: 0 microversion: 2.1 time: 0.116394 Oct 23 02:17:11.905322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 289/571] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:11 2022] DELETE /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:17:11.915052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:11.915665 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:11.917763 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=35 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:11.918496 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=25 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:11.924969 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:11.925456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:11.926465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:11.927335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:11.927796 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:11.928228 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.059345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:12.067368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f2ace463-ccb1-405e-ae89-9367195f9311 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1577 microversion: 2.1 time: 0.157336 Oct 23 02:17:12.067934 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 283/572] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:11 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:12.385412 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:12.385996 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:12.391834 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.392321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.392755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.393439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.393890 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.394314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.425477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-83907608-26dd-468c-bd72-1172c8ebcc51 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments/ae91c74c-de9a-4093-8c61-c3bcd38c2c0c" status: 200 len: 194 microversion: 2.20 time: 0.147909 Oct 23 02:17:12.426074 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 290/573] 10.222.0.23 () {60 vars in 1454 bytes} [Sun Oct 23 02:17:12 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments/ae91c74c-de9a-4093-8c61-c3bcd38c2c0c => generated 194 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:17:12.496191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:12.496681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:12.502492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.503003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.503438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.504752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.505200 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.505622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.585934 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lazy-loading 'services' on Instance uuid 847628be-0620-4309-99c8-6036d43d26f7 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:12.668102 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-471ab563-da42-4f04-a4d9-9327c4e9ed01 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "DELETE /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments/ae91c74c-de9a-4093-8c61-c3bcd38c2c0c" status: 202 len: 0 microversion: 2.20 time: 0.175652 Oct 23 02:17:12.668692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 284/574] 10.222.0.23 () {60 vars in 1457 bytes} [Sun Oct 23 02:17:12 2022] DELETE /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments/ae91c74c-de9a-4093-8c61-c3bcd38c2c0c => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:17:12.677654 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:12.679898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:12.685964 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.686461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.686904 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.687589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:12.688038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:12.688456 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:12.718065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0c59ca26-5f69-490b-9ac5-a681c8771efe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044817 Oct 23 02:17:12.718635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 291/575] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 23 02:17:12 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:17:13.091728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:13.092428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:13.099164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:13.099644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:13.100080 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:13.100766 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:13.101222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:13.101650 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:13.235668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:13.244822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-28808e58-e457-405c-adcb-5f2e1cb25358 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1577 microversion: 2.1 time: 0.157788 Oct 23 02:17:13.245411 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 285/576] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:13 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:13.730791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:13.732914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:13.739336 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:13.739813 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:13.740244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:13.740923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:13.741377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:13.741799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:13.771035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2644ceca-5f22-473d-b96c-ec4920bcf924 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044232 Oct 23 02:17:13.771581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 292/577] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 23 02:17:13 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:17:14.268131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:14.268905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:14.275494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:14.276243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:14.276676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:14.277368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:14.277823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:14.278246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:14.463736 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:14.471641 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-427176bd-d1b7-4901-bc64-2df6466c25ab tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1577 microversion: 2.1 time: 0.207446 Oct 23 02:17:14.472221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 286/578] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:14 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:14.783995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:14.787014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:14.793681 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:14.794167 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:14.794628 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:14.795370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:14.795820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:14.796237 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:14.828242 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-15cd76c9-4f7b-4bcf-bc59-46ba1c6a6db1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048239 Oct 23 02:17:14.828827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 293/579] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 23 02:17:14 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:14.897409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:14.897909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:14.904499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:14.904989 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:14.905428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:14.906140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:14.906637 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:14.907091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:14.934692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:15.012956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-88b91a67-eed0-4943-b765-186d9e764c26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "DELETE /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 204 len: 0 microversion: 2.20 time: 0.119799 Oct 23 02:17:15.017037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 287/580] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 23 02:17:14 2022] DELETE /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 02:17:15.023205 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:15.023815 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:15.030212 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:15.030752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:15.031187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:15.031877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:15.032313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:15.032910 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:15.225821 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:15.234516 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:15.236114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:15.237367 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-da0df9da-3189-40cd-b806-beb6bc16dcdd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.219001 Oct 23 02:17:15.238329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 294/581] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:15 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:15.496379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:15.498020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:15.507448 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:15.508180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:15.508787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:15.509658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:15.510268 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:15.510875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:15.584771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:15.593058 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-18673619-b868-41a7-8d9d-61465bf7175a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1510 microversion: 2.1 time: 0.100951 Oct 23 02:17:15.608672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 288/582] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:15 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1510 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:15.622097 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-74e65343-2595-4413-aa15-46b62ab57c54 req-947f14ff-8a55-4686-bcca-e82a609cb7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db07175d-130c-4921-9d80-695f6a7d3d0c", "name": "network-vif-deleted", "tag": "e35e85c2-0e59-4bf7-a05a-481d96c99ce9"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:15.632219 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-74e65343-2595-4413-aa15-46b62ab57c54 req-947f14ff-8a55-4686-bcca-e82a609cb7c0 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:15.632697 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-74e65343-2595-4413-aa15-46b62ab57c54 req-947f14ff-8a55-4686-bcca-e82a609cb7c0 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:15.633124 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-74e65343-2595-4413-aa15-46b62ab57c54 req-947f14ff-8a55-4686-bcca-e82a609cb7c0 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:15.644285 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-74e65343-2595-4413-aa15-46b62ab57c54 req-947f14ff-8a55-4686-bcca-e82a609cb7c0 service nova] Creating event network-vif-deleted:e35e85c2-0e59-4bf7-a05a-481d96c99ce9 for instance db07175d-130c-4921-9d80-695f6a7d3d0c on hv-cinder-86149 Oct 23 02:17:15.650004 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-74e65343-2595-4413-aa15-46b62ab57c54 req-947f14ff-8a55-4686-bcca-e82a609cb7c0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095976 Oct 23 02:17:15.651079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 295/583] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:17:16.264507 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:16.265286 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:16.272874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:16.273434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:16.273959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:16.274755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:16.275278 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:16.276041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:16.423245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:16.433151 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:16.434792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:16.436060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1818440d-1f12-491f-bd37-4489185dc8dc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.177761 Oct 23 02:17:16.436717 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 289/584] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:16 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:16.618128 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:16.619254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:16.625560 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:16.626046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:16.626511 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:16.627207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:16.627659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:16.628082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:16.694753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:16.703707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9581d2b9-71e5-44f0-a700-69b1890c3882 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1225 microversion: 2.1 time: 0.090968 Oct 23 02:17:16.704553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 296/585] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:16 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:17.462541 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:17.463016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:17.469769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:17.470354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:17.470982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:17.471749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:17.473621 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:17.474541 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:17.679889 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:17.688197 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:17.689686 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:17.691611 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ddb6e10a-2a07-45e4-b61d-ba14a8b334d5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1723 microversion: 2.20 time: 0.232851 Oct 23 02:17:17.693095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 290/586] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:17 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:17.727966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:17.728508 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:17.734919 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:17.735393 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:17.735881 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:17.736569 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:17.737015 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:17.737430 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:17.775955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:17.776440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:17.776866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:17.777308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lazy-loading 'fault' on Instance uuid db07175d-130c-4921-9d80-695f6a7d3d0c {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:17.832599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:17.839984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-44a8c11c-62be-4302-81f8-c0b0bcadd7e9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 200 len: 1184 microversion: 2.1 time: 0.116761 Oct 23 02:17:17.840557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 297/587] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:17 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 1184 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:18.056928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-6e82f67e-54d1-4bdf-8bf3-6860bc214462 req-dbb4b1cc-9dc4-40a6-9424-cfbc7d6b8e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847628be-0620-4309-99c8-6036d43d26f7", "name": "network-vif-deleted", "tag": "24fbd91b-949f-4c46-a496-148c4722eb45"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:18.072885 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-6e82f67e-54d1-4bdf-8bf3-6860bc214462 req-dbb4b1cc-9dc4-40a6-9424-cfbc7d6b8e46 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.073872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-6e82f67e-54d1-4bdf-8bf3-6860bc214462 req-dbb4b1cc-9dc4-40a6-9424-cfbc7d6b8e46 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.074546 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-6e82f67e-54d1-4bdf-8bf3-6860bc214462 req-dbb4b1cc-9dc4-40a6-9424-cfbc7d6b8e46 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.089145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-6e82f67e-54d1-4bdf-8bf3-6860bc214462 req-dbb4b1cc-9dc4-40a6-9424-cfbc7d6b8e46 service nova] Creating event network-vif-deleted:24fbd91b-949f-4c46-a496-148c4722eb45 for instance 847628be-0620-4309-99c8-6036d43d26f7 on hv-cinder-86149 Oct 23 02:17:18.094894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-6e82f67e-54d1-4bdf-8bf3-6860bc214462 req-dbb4b1cc-9dc4-40a6-9424-cfbc7d6b8e46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041280 Oct 23 02:17:18.096348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 291/588] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:18.720319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:18.721029 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:18.728459 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.730197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.730670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.731611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.732066 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.732481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.766291 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.767022 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.767675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.768210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lazy-loading 'fault' on Instance uuid 847628be-0620-4309-99c8-6036d43d26f7 {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:18.814011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:18.831048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:18.834065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:18.841900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e83668f4-c155-4838-a38b-fa01cef08af9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 200 len: 1371 microversion: 2.20 time: 0.119258 Oct 23 02:17:18.842597 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 298/589] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:18 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:18.864886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:18.865589 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:18.872245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.872735 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.873179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.873893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:18.874347 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:18.875021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:18.889481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] HTTP exception thrown: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Request method failure captured: Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c HTTP/1.1 Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKNDHKikYXu23VSMbM8Uv3FK0IPJ8BV-XvHTQkhR-gU_ntrUIDSLgSDf4VbyaB0csCGtTcWi2whWptTEyq1CsbMUxtfeUzpAsKSmbrwY6t309FI7ZFfH267GACBGXuM3hQIom1pyEQexspKc8Ns4k5SvhUV8XW97_J-w6G9mMSb4NPw Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:17:18.892068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-TestVolumeBootPattern-182285566 Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: d8cd3210dbea46d6912c93c6d28356ae Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:17:18.893785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'db07175d-130c-4921-9d80-695f6a7d3d0c'} Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:18.895477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:17:18.897212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:18.898636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Returning 404 to user: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:18.898636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-09d098a6-a9aa-44f3-9b48-c3cd14425392 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 404 len: 111 microversion: 2.1 time: 0.033704 Oct 23 02:17:18.903141 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 292/590] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:18 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:19.005068 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1263655555", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1022248569", "security_groups": [{"name": "tempest-secgroup-smoke-301932947"}], "block_device_mapping_v2": [{"uuid": "b0a919e2-97d8-48f0-967d-85145268dee7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c5e8bc1-ae7a-4263-95d0-aa588702beec"}]}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:19.123276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] validate_networks() for [('6c5e8bc1-ae7a-4263-95d0-aa588702beec', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:17:19.542489 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:17:19.542916 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:17:19.543387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:17:19.543793 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:17:19.544203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:17:19.553153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:19.553626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:19.554058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:19.554809 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:19.555270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:19.555691 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:19.577229 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Getting quotas for project 10f27676e78f475fa9734f3d6f541da5. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:19.581176 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Getting quotas for user d8cd3210dbea46d6912c93c6d28356ae and project 10f27676e78f475fa9734f3d6f541da5. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:19.646211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:17:19.648365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0a919e2-97d8-48f0-967d-85145268dee7',volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:17:19.780445 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d16be919-ad45-4c0d-9385-4c4f447b3e15 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.780586 Oct 23 02:17:19.781072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 299/591] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:17:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:17:19.793886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d5c1ef01-3c22-430a-adb8-1006c26112a8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:19.794536 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d5c1ef01-3c22-430a-adb8-1006c26112a8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:19.852576 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d5c1ef01-3c22-430a-adb8-1006c26112a8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:19.859517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d5c1ef01-3c22-430a-adb8-1006c26112a8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1095 microversion: 2.1 time: 0.069713 Oct 23 02:17:19.860087 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 293/592] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:19 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:19.874132 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:19.874796 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:19.882300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:19.882893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:19.883333 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:19.884024 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:19.884478 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:19.884906 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:19.898797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] HTTP exception thrown: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Request method failure captured: Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 HTTP/1.1 Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLIGEqQmwUSJthYJwlvsBnS0vL1IeeZm_XKB7TVg9iFJh5_GjgO5d9ODbvXHqflrzLn1EtcEgbLu3nQEJ7RX5_05-Og4tYU_zlN2rM6fKlA68rtW-UQDoQzGBqml7oqSfXwsaatmOXLV8sI67nA3Vs7vxisi392Xc5SjjmsqaqCpcs Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:17:19.900744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: c9dba6c5f7e9472faa5aa963758d78fe Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:17:19.902301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '847628be-0620-4309-99c8-6036d43d26f7'} Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:19.903126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:17:19.904258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:19.905352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Returning 404 to user: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:19.905352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-51e804d4-f99a-4ce5-be5f-7c331a6ffabf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 404 len: 111 microversion: 2.20 time: 0.036887 Oct 23 02:17:19.905352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 300/593] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:19 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:17:19.912008 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1e594f02-9a98-477d-aa7a-46187fa30dbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '.version_select at 0x7f9da2edc310>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:19.937892 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1e594f02-9a98-477d-aa7a-46187fa30dbb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122928426" status: 204 len: 0 microversion: 2.20 time: 0.030490 Oct 23 02:17:19.938497 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 294/594] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 23 02:17:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122928426 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 02:17:20.595804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-59ea7471-0015-41ea-adc8-0f7fcf53eadd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'create', calling method: .version_select at 0x7f9da2ebae50>, body: {"keypair": {"name": "tempest-keypair-1406277432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaZKLqUPGpUIDYcryZY5cvLAiHwljziZUyDFnYRuwZ4S0gT/hAMAsfxjIo/Yqbq+0e1fEMyZAk0Q5mDLmZL5VfKbvLSYm1PITXqpJVmN0mDj9J1qXN9qrZQFXclHTehQg=="}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:20.611337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-59ea7471-0015-41ea-adc8-0f7fcf53eadd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Getting quotas for project fa4d62bf272e4ce69022518ff362813f. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:20.615606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-59ea7471-0015-41ea-adc8-0f7fcf53eadd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Getting quotas for user c9dba6c5f7e9472faa5aa963758d78fe and project fa4d62bf272e4ce69022518ff362813f. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:20.639963 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-59ea7471-0015-41ea-adc8-0f7fcf53eadd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048102 Oct 23 02:17:20.640548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 301/595] 10.222.0.23 () {62 vars in 1200 bytes} [Sun Oct 23 02:17:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 23 02:17:20.884636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:20.885379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:20.891666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:20.892176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:20.892609 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:20.893303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:20.894323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:20.895160 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:20.966897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:20.974869 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bb07d97d-bd72-4ca8-afcc-4029fea708a4 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1193 microversion: 2.1 time: 0.094944 Oct 23 02:17:20.975445 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 295/596] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:20 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:21.854884 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1579161566", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bfefda5-1c31-4cf3-a13e-af4e5cedf457"}], "security_groups": [{"name": "tempest-securitygroup--1460824578"}], "key_name": "tempest-keypair-1406277432", "user_data": "}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:22.000414 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:22.001540 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:22.013537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:22.015191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:22.015605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:22.016711 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:22.020127 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:22.021070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:22.069361 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] validate_networks() for [('7bfefda5-1c31-4cf3-a13e-af4e5cedf457', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:17:22.391574 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:22.400431 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0f4560e8-8f90-4032-8682-a8049e148b41 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1278 microversion: 2.1 time: 0.404377 Oct 23 02:17:22.401111 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 296/597] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:21 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1278 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:22.825941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:17:22.826507 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:17:22.827050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:17:22.827526 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:17:22.828034 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:17:22.837407 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:22.837890 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:22.838324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:22.839076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:22.839523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:22.839973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:22.860067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Getting quotas for project fa4d62bf272e4ce69022518ff362813f. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:22.864455 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Getting quotas for user c9dba6c5f7e9472faa5aa963758d78fe and project fa4d62bf272e4ce69022518ff362813f. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:22.876833 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:17:22.879716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:17:22.928102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e6d52bdf-1d51-4b8b-b40d-175bb2a4421e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.078010 Oct 23 02:17:22.935020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 302/598] 10.222.0.23 () {62 vars in 1188 bytes} [Sun Oct 23 02:17:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 23 02:17:22.942872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ac311275-81ff-4e2b-921c-6a51da560f5b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:22.943634 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ac311275-81ff-4e2b-921c-6a51da560f5b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:23.269793 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ac311275-81ff-4e2b-921c-6a51da560f5b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:23.283240 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ac311275-81ff-4e2b-921c-6a51da560f5b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:23.285323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ac311275-81ff-4e2b-921c-6a51da560f5b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:23.287040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ac311275-81ff-4e2b-921c-6a51da560f5b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1282 microversion: 2.20 time: 0.349846 Oct 23 02:17:23.288156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 297/599] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:22 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1282 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:23.427273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:23.427921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:23.433035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-bfa771e5-845b-40c8-a0a3-b063b6cd67c9 req-02b141c7-8097-4ef4-b124-b669f9bedd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd81b2ca-f9cb-4bc3-a344-a92633a5d73f", "tag": "444e7dad-cf05-44e1-b92d-e45dbabfd2fb"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:23.437206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:23.437756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:23.438240 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:23.439604 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:23.440065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:23.440730 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:23.455118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bfa771e5-845b-40c8-a0a3-b063b6cd67c9 req-02b141c7-8097-4ef4-b124-b669f9bedd76 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:23.456879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bfa771e5-845b-40c8-a0a3-b063b6cd67c9 req-02b141c7-8097-4ef4-b124-b669f9bedd76 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:23.457901 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bfa771e5-845b-40c8-a0a3-b063b6cd67c9 req-02b141c7-8097-4ef4-b124-b669f9bedd76 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:23.469661 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-bfa771e5-845b-40c8-a0a3-b063b6cd67c9 req-02b141c7-8097-4ef4-b124-b669f9bedd76 service nova] Creating event network-changed:444e7dad-cf05-44e1-b92d-e45dbabfd2fb for instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f on hv-cinder-86149 Oct 23 02:17:23.476182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-bfa771e5-845b-40c8-a0a3-b063b6cd67c9 req-02b141c7-8097-4ef4-b124-b669f9bedd76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050217 Oct 23 02:17:23.477518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 298/600] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:17:23.671670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:23.679886 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e53ce7da-0a0b-408b-bf25-580e3328845d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.259033 Oct 23 02:17:23.680707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 303/601] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:23 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:24.313965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:24.314592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:24.321668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:24.322176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:24.322639 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:24.323322 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:24.323765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:24.324319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:24.396739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:24.405608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:24.406956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:24.408279 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-022c1427-16aa-46a5-b22e-29d694a64c17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1334 microversion: 2.20 time: 0.100094 Oct 23 02:17:24.408679 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 299/602] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:24 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:24.705234 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:24.705867 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:24.712264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:24.712746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:24.713182 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:24.713864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:24.714312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:24.714759 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:24.847411 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:24.856667 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3f4da66d-0721-4a2f-aaeb-7d7a2d4d6178 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.155348 Oct 23 02:17:24.857237 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 304/603] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:24 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:25.433804 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:25.434383 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:25.441030 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:25.441509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:25.441938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:25.442688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:25.443187 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:25.443709 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:25.507752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:25.515662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:25.517086 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:25.518687 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f989d71d-e4f9-4920-8631-2dd96011f807 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1340 microversion: 2.20 time: 0.088982 Oct 23 02:17:25.519302 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 300/604] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:25 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1340 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:25.880728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:25.881888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:25.888378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:25.888859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:25.889288 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:25.889978 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:25.890454 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:25.890877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:26.161992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:26.170811 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8478ede9-4778-444f-9a54-95f19388cb3a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.295161 Oct 23 02:17:26.171474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 305/605] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:25 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:26.546775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:26.548136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:26.563226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:26.563644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:26.564084 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:26.564800 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:26.565789 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:26.566468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:26.829299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:26.837952 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:26.839427 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:26.840525 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-88a01e51-9d06-437b-be09-b966439c206b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.298129 Oct 23 02:17:26.841082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 301/606] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:26 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:27.197424 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:27.198639 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:27.204590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:27.205073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:27.205511 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:27.206581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:27.206716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:27.207103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:27.229172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-daceea7e-c240-4ae2-afa3-ebd87257b107 req-47dc9799-753b-4d44-b691-6e8eef3222bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdb83af-0870-4f45-9164-d5539f2d667a", "tag": "d1b009dc-238c-4b94-abcc-f85c7f608d94"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:27.243171 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-daceea7e-c240-4ae2-afa3-ebd87257b107 req-47dc9799-753b-4d44-b691-6e8eef3222bf service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:27.243786 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-daceea7e-c240-4ae2-afa3-ebd87257b107 req-47dc9799-753b-4d44-b691-6e8eef3222bf service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:27.244617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-daceea7e-c240-4ae2-afa3-ebd87257b107 req-47dc9799-753b-4d44-b691-6e8eef3222bf service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:27.250556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:27.261305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-daceea7e-c240-4ae2-afa3-ebd87257b107 req-47dc9799-753b-4d44-b691-6e8eef3222bf service nova] Creating event network-changed:d1b009dc-238c-4b94-abcc-f85c7f608d94 for instance 3fdb83af-0870-4f45-9164-d5539f2d667a on hv-cinder-86149 Oct 23 02:17:27.266689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-daceea7e-c240-4ae2-afa3-ebd87257b107 req-47dc9799-753b-4d44-b691-6e8eef3222bf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041611 Oct 23 02:17:27.267293 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 302/607] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:17:27.453899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:27.458060 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:27.463523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-35826adb-ed51-4c81-a3c0-dee95fbca4da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.269623 Oct 23 02:17:27.474537 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 306/608] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:27 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:27.866882 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:27.867578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:27.876831 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:27.877316 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:27.877753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:27.878553 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:27.879009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:27.879433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:28.014763 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:28.023338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:28.025045 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:28.026146 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-eede24dd-3c56-4b5f-b3d9-673f1d4fc44f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.164360 Oct 23 02:17:28.026758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 303/609] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:27 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:28.486735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:28.487456 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:28.495198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:28.495676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:28.496105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:28.496780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:28.497232 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:28.497654 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:28.637159 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:28.645397 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-48b29093-6f57-47d5-94d1-cac0f270a5a3 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.162524 Oct 23 02:17:28.645949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 307/610] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:28 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:29.051924 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:29.052499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:29.058929 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:29.059437 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:29.059959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:29.060718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:29.061256 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:29.061710 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:29.193959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:29.202043 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:29.203517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:29.204614 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2d9be640-cde3-40a2-a795-f52111ea090b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.156868 Oct 23 02:17:29.205192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 304/611] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:29 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:29.668499 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:29.669143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:29.676484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:29.676900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:29.677359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:29.678100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:29.678633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:29.679061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:29.811331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:29.819270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e6749b54-c8dc-45c0-9377-44275cbef041 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.154647 Oct 23 02:17:29.819823 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 308/612] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:29 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:30.231774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:30.232389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:30.238930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:30.239417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:30.239884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:30.240632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:30.241118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:30.241544 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:30.372528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:30.382087 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:30.383564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:30.384668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c60c901e-9f34-4b4c-bc55-862cd745ee2c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.157006 Oct 23 02:17:30.385227 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 305/613] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:30 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:17:30.842972 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:30.843486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:30.850602 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:30.851079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:30.851504 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:30.852197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:30.852643 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:30.853057 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:30.985200 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:30.993319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9916d108-07fc-4742-b681-b6e5f822327a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.154470 Oct 23 02:17:30.993869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 309/614] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:30 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:31.410631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:31.411241 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:31.417567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:31.418038 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:31.418490 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:31.419172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:31.419617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:31.420032 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:31.551249 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:31.559159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:31.560587 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:31.561671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-83d1ecac-2e94-46fc-8c0b-106657477af1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.155575 Oct 23 02:17:31.562231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 306/615] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:31 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:32.017705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:32.019063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.025696 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.026184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.026678 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.027377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.027835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.028263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.123261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:32.123783 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.129801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.130290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.130764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.131468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.131923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.132351 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.163498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-14667b3c-fde8-4f21-be52-b431b77b02d3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5/ips" status: 200 len: 150 microversion: 2.1 time: 0.044785 Oct 23 02:17:32.170736 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 307/616] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:17:32 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:17:32.178408 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f97306f-d4a0-4470-8017-712846ac2a96"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:32.180938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.187199 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.187685 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.188152 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.188859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.189316 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.189778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.289604 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Invalid volume: volume 8f97306f-d4a0-4470-8017-712846ac2a96 is already attached to instances: d89425f0-1391-4e8f-9135-b292f96bbb8f Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: POST /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5/os-volume_attachments HTTP/1.1 Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 74 Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:17:32.292348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {"volumeAttachment": {"volumeId": "8f97306f-d4a0-4470-8017-712846ac2a96"}} Oct 23 02:17:32.293905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Invalid volume: volume 8f97306f-d4a0-4470-8017-712846ac2a96 is already attached to instances: d89425f0-1391-4e8f-9135-b292f96bbb8f Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'server_id': '2bc846d9-9f7a-4a4a-a027-4117c043b0e5', 'body': {'volumeAttachment': {'volumeId': '8f97306f-d4a0-4470-8017-712846ac2a96'}}} Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8f97306f-d4a0-4470-8017-712846ac2a96 is already attached to instances: d89425f0-1391-4e8f-9135-b292f96bbb8f Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:32.295547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8f97306f-d4a0-4470-8017-712846ac2a96 is already attached to instances: d89425f0-1391-4e8f-9135-b292f96bbb8f Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:32.296787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:32.297962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:32.297962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:32.297962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:32.297962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8f97306f-d4a0-4470-8017-712846ac2a96 is already attached to instances: d89425f0-1391-4e8f-9135-b292f96bbb8f Oct 23 02:17:32.297962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:32.297962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 400 to user: Invalid volume: volume 8f97306f-d4a0-4470-8017-712846ac2a96 is already attached to instances: d89425f0-1391-4e8f-9135-b292f96bbb8f {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:32.297962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f2814702-4670-4b60-9b2f-b848344b18fe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123128 Oct 23 02:17:32.297962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 308/617] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:17:32 2022] POST /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:17:32.305427 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:32.305932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.313201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.313700 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.314138 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.314964 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.315425 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.315852 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.344269 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:32.435681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5c71be7a-77d9-4d05-8bf4-0bad559d933c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 204 len: 0 microversion: 2.1 time: 0.133517 Oct 23 02:17:32.436842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 309/618] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:32 2022] DELETE /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:17:32.446322 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:32.447712 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.453949 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.454716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.455820 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.456680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.457260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.457853 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.652253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:32.660037 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-57a4b34d-8ca9-47c6-adb6-3d6cdcedcbc0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.646770 Oct 23 02:17:32.660595 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 310/619] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:32 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:32.665009 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:32.665597 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:32.679385 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.680078 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.680669 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.681521 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:32.682124 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:32.682732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:32.777145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:32.785560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1dc9e2cc-3eb6-412d-9a10-f6f7d729379a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1683 microversion: 2.1 time: 0.343547 Oct 23 02:17:32.786346 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 310/620] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:32 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1683 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:32.836663 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:32.844878 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:32.847147 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:32.848277 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-01ea047b-0329-4737-b77e-35a75a842fcb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.186767 Oct 23 02:17:32.848837 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 311/621] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:32 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:33.682599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:33.683223 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:33.685181 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=4 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:33.691705 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:33.692190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:33.692629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:33.693317 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:33.693770 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:33.694191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:33.808727 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:33.809354 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:33.811183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=4 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:33.812007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=16 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:33.815759 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:33.821221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:33.821700 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:33.822129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:33.822869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:33.823343 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:33.823756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:33.923067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:33.932095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-24e728b5-42fb-42fa-b1e2-12efa4d11df9 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.253349 Oct 23 02:17:33.932731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 311/622] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:33 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:33.937410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:33.938283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:33.945666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:33.946231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:33.946768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:33.947538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:33.947990 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:33.948416 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:34.081699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:34.089375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1ac9a9ab-8275-4bc0-9d2a-9e88be8ff766 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1683 microversion: 2.1 time: 0.284553 Oct 23 02:17:34.089970 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 312/623] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:33 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1683 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:34.161927 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:34.170581 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:34.172662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:34.174385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fb04ba82-8026-4565-a1f8-673bb189965f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.240187 Oct 23 02:17:34.175167 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 312/624] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:33 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:34.545377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-2157928f-0540-4f99-9c90-3cfa37a038d5 req-0c951a3f-546c-4b6b-aad0-02cd42637f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb83af-0870-4f45-9164-d5539f2d667a", "name": "network-vif-plugged", "status": "completed", "tag": "d1b009dc-238c-4b94-abcc-f85c7f608d94"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:34.556839 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-2157928f-0540-4f99-9c90-3cfa37a038d5 req-0c951a3f-546c-4b6b-aad0-02cd42637f37 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:34.557321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-2157928f-0540-4f99-9c90-3cfa37a038d5 req-0c951a3f-546c-4b6b-aad0-02cd42637f37 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:34.557746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-2157928f-0540-4f99-9c90-3cfa37a038d5 req-0c951a3f-546c-4b6b-aad0-02cd42637f37 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:34.576038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-2157928f-0540-4f99-9c90-3cfa37a038d5 req-0c951a3f-546c-4b6b-aad0-02cd42637f37 service nova] Creating event network-vif-plugged:d1b009dc-238c-4b94-abcc-f85c7f608d94 for instance 3fdb83af-0870-4f45-9164-d5539f2d667a on hv-cinder-86149 Oct 23 02:17:34.581834 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-2157928f-0540-4f99-9c90-3cfa37a038d5 req-0c951a3f-546c-4b6b-aad0-02cd42637f37 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105559 Oct 23 02:17:34.582432 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 313/625] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:34.956839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:34.958285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:34.965514 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:34.966354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:34.967060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:34.968026 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:34.968695 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:34.969353 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:35.116411 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:35.117661 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:35.130281 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:35.130872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:35.131307 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:35.132167 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:35.132657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:35.133091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:35.259674 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:35.268935 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cdbab026-7834-4d1e-957f-5a27c8a20c1f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1615 microversion: 2.1 time: 0.157936 Oct 23 02:17:35.269529 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 314/626] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:35 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1615 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:35.274688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:35.275280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:35.280929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:35.281617 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:35.282043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:35.282751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:35.284387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:35.284839 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:35.309678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:35.317996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-50f68410-2661-4f94-955c-363245fd8ce8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.366569 Oct 23 02:17:35.318632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 313/627] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:34 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:35.527037 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:35.536417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:35.537966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:35.539188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a95fdd29-ea12-40be-853c-8affd1a99172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.268648 Oct 23 02:17:35.554470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 315/628] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:35 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:35.634839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-9b2928aa-4358-4386-b7d1-913612584588 req-7c8bd459-b25f-4a38-8783-dc3e2ff2a8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc846d9-9f7a-4a4a-a027-4117c043b0e5", "name": "network-vif-deleted", "tag": "853b17f0-ba1e-401a-9632-0f158dc66a3e"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:35.645046 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-9b2928aa-4358-4386-b7d1-913612584588 req-7c8bd459-b25f-4a38-8783-dc3e2ff2a8d0 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:35.645607 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-9b2928aa-4358-4386-b7d1-913612584588 req-7c8bd459-b25f-4a38-8783-dc3e2ff2a8d0 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:35.646115 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-9b2928aa-4358-4386-b7d1-913612584588 req-7c8bd459-b25f-4a38-8783-dc3e2ff2a8d0 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:35.657404 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-9b2928aa-4358-4386-b7d1-913612584588 req-7c8bd459-b25f-4a38-8783-dc3e2ff2a8d0 service nova] Creating event network-vif-deleted:853b17f0-ba1e-401a-9632-0f158dc66a3e for instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 on hv-cinder-86149 Oct 23 02:17:35.662810 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-9b2928aa-4358-4386-b7d1-913612584588 req-7c8bd459-b25f-4a38-8783-dc3e2ff2a8d0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031697 Oct 23 02:17:35.663445 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 314/629] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:36.294089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:36.294734 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.302060 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.302590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.303025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.303719 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.304191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.304797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.341686 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:36.342379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.350107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.350632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.351068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.351777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.352230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.352650 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.373858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.382552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e3140a67-1dfa-4eaf-8930-32a2a5e888e6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1327 microversion: 2.1 time: 0.092668 Oct 23 02:17:36.383408 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 316/630] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:36 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:36.510202 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.519350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7d72d89e-00b3-41e6-8c8d-5d5ae32ad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.181662 Oct 23 02:17:36.519946 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 315/631] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:36 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:36.569671 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:36.570539 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:36.577694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.578122 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.578584 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.579292 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.581188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.581583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.608656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-0a4d8bb6-c112-490e-9537-8ff0bc627923 req-2ab2ff8f-9457-4a1a-87ba-85f003833b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd81b2ca-f9cb-4bc3-a344-a92633a5d73f", "name": "network-vif-plugged", "status": "completed", "tag": "444e7dad-cf05-44e1-b92d-e45dbabfd2fb"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:36.620229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-0a4d8bb6-c112-490e-9537-8ff0bc627923 req-2ab2ff8f-9457-4a1a-87ba-85f003833b1a service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:36.620992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-0a4d8bb6-c112-490e-9537-8ff0bc627923 req-2ab2ff8f-9457-4a1a-87ba-85f003833b1a service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:36.621452 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-0a4d8bb6-c112-490e-9537-8ff0bc627923 req-2ab2ff8f-9457-4a1a-87ba-85f003833b1a service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:36.635127 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-0a4d8bb6-c112-490e-9537-8ff0bc627923 req-2ab2ff8f-9457-4a1a-87ba-85f003833b1a service nova] Creating event network-vif-plugged:444e7dad-cf05-44e1-b92d-e45dbabfd2fb for instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f on hv-cinder-86149 Oct 23 02:17:36.640271 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-0a4d8bb6-c112-490e-9537-8ff0bc627923 req-2ab2ff8f-9457-4a1a-87ba-85f003833b1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046642 Oct 23 02:17:36.641317 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 316/632] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:36.723669 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.732148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.733637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:36.734865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9aa91d25-3ba5-485c-bb44-1af73f10ca04 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1408 microversion: 2.20 time: 0.172894 Oct 23 02:17:36.735429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 317/633] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:36 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:37.406943 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.408059 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.415012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.415694 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.416146 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.416842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.417298 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.417725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.449798 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.450301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.450771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.451216 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lazy-loading 'fault' on Instance uuid 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:37.492980 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:37.500522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-220fe06e-a0f2-49da-9db0-e8ef5f7e2a2d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1332 microversion: 2.1 time: 0.098124 Oct 23 02:17:37.501107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 317/634] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:37 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:37.543385 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.543998 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.550557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.551039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.551473 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.552185 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.552639 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.553099 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.687629 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:37.695417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9808b661-8f2a-4da9-b2e3-7512f408e69b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.155841 Oct 23 02:17:37.695978 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 318/635] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:37 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:37.761115 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.761749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.768594 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.769068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.769494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.770176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.770653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.771074 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.937423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:37.946091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:37.947554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:37.948723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e6f00b97-c954-450b-84ae-3d1244cb0a47 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1600 microversion: 2.20 time: 0.191557 Oct 23 02:17:37.949273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 318/636] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:17:37 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1600 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:17:37.974153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:37.974676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:37.980428 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.980924 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.981349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:37.982018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:37.982481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:37.982903 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:38.060298 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6243af6d-7d4e-40ce-b172-6a51ca59b9cd tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090541 Oct 23 02:17:38.060889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 319/637] 10.222.0.23 () {60 vars in 1316 bytes} [Sun Oct 23 02:17:37 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:17:38.523865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:38.524747 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:38.531792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:38.531792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:38.532097 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:38.533339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:38.533818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:38.534301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:38.538706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:38.568272 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:38.568669 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:38.569096 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:38.569531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lazy-loading 'fault' on Instance uuid 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:38.643546 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:38.651439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e64ee229-83f5-47be-ac44-a56d70e4935f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1332 microversion: 2.1 time: 0.131405 Oct 23 02:17:38.652011 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 319/638] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:38 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1332 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:38.719050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:38.719684 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:38.725922 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:38.726406 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:38.726876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:38.727563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:38.728015 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:38.728437 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:38.941338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:38.948865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2b9ae993-a8cc-41cb-86f3-61a1dbd44d87 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1266 microversion: 2.1 time: 0.234195 Oct 23 02:17:38.949429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 320/639] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:38 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:39.090719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-a6d38560-e756-4b4d-88c6-601273cb8d42 req-f553773e-5716-49f7-bfd5-c471298ed2ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fdb83af-0870-4f45-9164-d5539f2d667a", "tag": "d1b009dc-238c-4b94-abcc-f85c7f608d94"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:39.100763 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a6d38560-e756-4b4d-88c6-601273cb8d42 req-f553773e-5716-49f7-bfd5-c471298ed2ab service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:39.101237 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a6d38560-e756-4b4d-88c6-601273cb8d42 req-f553773e-5716-49f7-bfd5-c471298ed2ab service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:39.101664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a6d38560-e756-4b4d-88c6-601273cb8d42 req-f553773e-5716-49f7-bfd5-c471298ed2ab service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:39.114776 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-a6d38560-e756-4b4d-88c6-601273cb8d42 req-f553773e-5716-49f7-bfd5-c471298ed2ab service nova] Creating event network-changed:d1b009dc-238c-4b94-abcc-f85c7f608d94 for instance 3fdb83af-0870-4f45-9164-d5539f2d667a on hv-cinder-86149 Oct 23 02:17:39.119766 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-a6d38560-e756-4b4d-88c6-601273cb8d42 req-f553773e-5716-49f7-bfd5-c471298ed2ab service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032801 Oct 23 02:17:39.120355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 320/640] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:39.673733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:39.674492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:39.680509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:39.680967 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:39.681401 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:39.682149 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:39.682631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:39.683053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:39.716106 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:39.716643 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:39.717121 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:39.717589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lazy-loading 'fault' on Instance uuid 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:39.758230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:39.765897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-df94a5f9-6299-44fd-b19b-6342d1865a8f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 200 len: 1332 microversion: 2.1 time: 0.096673 Oct 23 02:17:39.766497 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 321/641] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:39 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:39.975914 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:39.977330 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:39.983053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:39.988533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:39.989628 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:39.990486 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:39.992283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:39.992971 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:39.993647 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.159411 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:40.159951 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:40.167206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.167702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.168136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.169039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.169493 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.169918 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.258943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lazy-loading 'services' on Instance uuid 91fc5747-8451-4657-979e-570ad7e73b8b {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:40.383703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bb145086-5e79-4ead-85e2-473b891c5a30 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments/7edc12d2-1dce-467e-af02-bc36dcd5c58e" status: 202 len: 0 microversion: 2.1 time: 0.230773 Oct 23 02:17:40.384919 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 322/642] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:17:40 2022] DELETE /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments/7edc12d2-1dce-467e-af02-bc36dcd5c58e => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:17:40.394376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:40.397089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:40.403693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.404396 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.405292 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.406203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.406686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.407108 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.420152 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:40.429258 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e24af710-ff3b-42d8-b396-41558e4141e8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1453 microversion: 2.1 time: 0.460324 Oct 23 02:17:40.429935 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 321/643] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:39 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1453 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:40.431265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:40.455109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:40.455851 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:40.460612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a32c5a72-0cf3-42d4-9ba3-440544063d7e tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070941 Oct 23 02:17:40.461148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 323/644] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:40 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:40.462056 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.462585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.463237 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.463974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.464465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.464896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.648022 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:40.656173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e3558373-bf48-44b3-8344-0195a2e6354c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1453 microversion: 2.1 time: 0.205406 Oct 23 02:17:40.656742 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 322/645] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:40 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1453 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:40.789553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:40.790196 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:40.796923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.797409 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.798738 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.799167 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:40.799627 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:40.800048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:40.813924 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 HTTP/1.1 Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:17:40.815611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:17:40.817198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '2bc846d9-9f7a-4a4a-a027-4117c043b0e5'} Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:40.818214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:17:40.819799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:40.821298 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:40.821298 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a667b7fa-a953-47be-8c3b-da2066322fab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 404 len: 111 microversion: 2.1 time: 0.031414 Oct 23 02:17:40.821298 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 324/646] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:40 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:40.826109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1368e5a6-39d5-4740-b552-2a00b37fd267 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '.version_select at 0x7f9da2e9ee50>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:40.846423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1368e5a6-39d5-4740-b552-2a00b37fd267 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741603251" status: 202 len: 0 microversion: 2.1 time: 0.024122 Oct 23 02:17:40.847217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 323/647] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 23 02:17:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741603251 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:17:41.474941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:41.476322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:41.483537 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.484138 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.484676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.485627 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.486215 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.486893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.521570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4e9e828a-f489-4dd6-9fb9-7389003e331d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052188 Oct 23 02:17:41.522259 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 325/648] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:41 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:41.533716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:41.534430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:41.542925 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.543501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.544008 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.544888 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.545409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.545907 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.641170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lazy-loading 'services' on Instance uuid d89425f0-1391-4e8f-9135-b292f96bbb8f {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:41.725837 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-42ff9df7-9681-4bf0-92b8-f92ed933b34b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments/8f97306f-d4a0-4470-8017-712846ac2a96" status: 202 len: 0 microversion: 2.1 time: 0.197595 Oct 23 02:17:41.726426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 324/649] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:17:41 2022] DELETE /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments/8f97306f-d4a0-4470-8017-712846ac2a96 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:17:41.735518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:41.737803 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:41.744356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.744882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.745629 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.746316 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:41.746943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:41.747370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:41.779608 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ed5ff69f-0af2-4d89-8776-0e1dc83f5acf tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048198 Oct 23 02:17:41.780178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 326/650] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:41 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:42.446873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-99928214-2893-431a-ab50-6fdc927df7da req-aab5b73f-6ed7-426c-8a3f-2a01572ecda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd81b2ca-f9cb-4bc3-a344-a92633a5d73f", "tag": "444e7dad-cf05-44e1-b92d-e45dbabfd2fb"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:42.456985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-99928214-2893-431a-ab50-6fdc927df7da req-aab5b73f-6ed7-426c-8a3f-2a01572ecda2 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.457428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-99928214-2893-431a-ab50-6fdc927df7da req-aab5b73f-6ed7-426c-8a3f-2a01572ecda2 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.457861 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-99928214-2893-431a-ab50-6fdc927df7da req-aab5b73f-6ed7-426c-8a3f-2a01572ecda2 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.469003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-99928214-2893-431a-ab50-6fdc927df7da req-aab5b73f-6ed7-426c-8a3f-2a01572ecda2 service nova] Creating event network-changed:444e7dad-cf05-44e1-b92d-e45dbabfd2fb for instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f on hv-cinder-86149 Oct 23 02:17:42.474854 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-99928214-2893-431a-ab50-6fdc927df7da req-aab5b73f-6ed7-426c-8a3f-2a01572ecda2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032398 Oct 23 02:17:42.475461 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 325/651] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:17:42.535044 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:42.537255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:42.552570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.553076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.553516 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.554225 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.554939 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.555373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.596130 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5630720f-4071-4149-96ac-f5b21e981100 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065591 Oct 23 02:17:42.596699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 327/652] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:42 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:17:42.676939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:42.678297 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:42.694341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.694827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.695262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.695963 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.696590 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.697012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.725170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:42.793251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:42.796310 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:42.806425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.810751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.811941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.812916 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.814880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.815867 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.840081 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f2ab867a-78d1-4f51-b3ab-fb61f9aaee7b tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "DELETE /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 204 len: 0 microversion: 2.1 time: 0.167078 Oct 23 02:17:42.844319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 326/653] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:42 2022] DELETE /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:17:42.851082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:42.852353 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:42.858954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b1fdbb21-323e-431f-80e7-11e173a946a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070064 Oct 23 02:17:42.859636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.860193 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.860622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:42.864881 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 328/654] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:42 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:17:42.865089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:42.865089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:42.865089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:43.001746 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:43.009434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-887b6bc0-0952-4c46-a343-583a22958176 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1689 microversion: 2.1 time: 0.162783 Oct 23 02:17:43.010013 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 327/655] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:42 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:43.872538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:43.874745 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:43.881219 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:43.881701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:43.882135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:43.882853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:43.883313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:43.883737 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:43.913062 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3866fc1f-6c2b-42f0-862a-2d66ff1a7de6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Oct 23 02:17:43.913612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 329/656] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:43 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:44.033688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:44.034228 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:44.040975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:44.041456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:44.041942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:44.042664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:44.043119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:44.043545 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:44.175976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:44.183735 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7f0ea5bf-e860-4492-a4e2-89ff625e2d10 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1689 microversion: 2.1 time: 0.154482 Oct 23 02:17:44.184306 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 328/657] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:44 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:44.926458 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:44.928634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:44.934975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:44.935446 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:44.935922 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:44.936546 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:44.936991 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:44.937409 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:44.967693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f763e8cc-9b67-4993-a857-9e3e0e1f763b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046168 Oct 23 02:17:44.968265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 330/658] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:44 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:45.206947 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:45.207494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:45.213776 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:45.214260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:45.214729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:45.215426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:45.215879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:45.216308 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:45.347494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:45.355191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-75a3e6c7-e6fa-46e6-9f9e-8352f04b6ef6 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1689 microversion: 2.1 time: 0.152374 Oct 23 02:17:45.355771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 329/659] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:45 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:45.980610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:45.982782 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:45.989422 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:45.989889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:45.990314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:45.991019 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:45.991463 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:45.991879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:46.021568 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-054a8652-3b56-4acb-b2e7-0e299e9b01a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Oct 23 02:17:46.022126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 331/660] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:45 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:46.379512 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:46.380127 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:46.386457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:46.386963 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:46.387403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:46.388091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:46.388541 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:46.388965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:46.518824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:46.527056 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c8c1fd34-9c24-4a16-857e-a6398664d088 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1689 microversion: 2.1 time: 0.151445 Oct 23 02:17:46.527574 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 330/661] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:46 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:47.035071 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:47.037296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:47.043377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.043850 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.044275 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.044953 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.045395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.046014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.076329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f4560659-80d5-4928-bbe7-c5e741bc76d1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046020 Oct 23 02:17:47.076959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 332/662] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:47 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 02:17:47.145133 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:47.146043 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:47.153163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.153653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.154208 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.154979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.155438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.155871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.182464 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:47.261571 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-669f498a-7bd3-4651-9350-bff36fd9a577 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 204 len: 0 microversion: 2.1 time: 0.121340 Oct 23 02:17:47.262567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 331/663] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:47 2022] DELETE /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:17:47.271073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:47.271670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:47.277952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.278475 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.278916 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.279596 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.280059 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.280461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.553399 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:47.554351 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:47.561450 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.561947 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.562381 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.563397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.563961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.564393 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.654309 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:47.662419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-196f9b90-671f-4ff7-aaa5-22c4a5489271 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1621 microversion: 2.1 time: 0.113924 Oct 23 02:17:47.674859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 332/664] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:47 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1621 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:47.726299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-8c70a565-9d8d-4055-a9d6-b56076491b72 req-57e6a7a8-e680-473d-bda5-500dc9c1ba28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91fc5747-8451-4657-979e-570ad7e73b8b", "name": "network-vif-deleted", "tag": "91964ab3-6465-4503-be0d-3facc3db73f3"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:47.737376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8c70a565-9d8d-4055-a9d6-b56076491b72 req-57e6a7a8-e680-473d-bda5-500dc9c1ba28 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:47.737974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8c70a565-9d8d-4055-a9d6-b56076491b72 req-57e6a7a8-e680-473d-bda5-500dc9c1ba28 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:47.738504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8c70a565-9d8d-4055-a9d6-b56076491b72 req-57e6a7a8-e680-473d-bda5-500dc9c1ba28 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:47.751778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-8c70a565-9d8d-4055-a9d6-b56076491b72 req-57e6a7a8-e680-473d-bda5-500dc9c1ba28 service nova] Creating event network-vif-deleted:91964ab3-6465-4503-be0d-3facc3db73f3 for instance 91fc5747-8451-4657-979e-570ad7e73b8b on hv-cinder-86149 Oct 23 02:17:47.756565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:47.757139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-8c70a565-9d8d-4055-a9d6-b56076491b72 req-57e6a7a8-e680-473d-bda5-500dc9c1ba28 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Oct 23 02:17:47.757894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 333/665] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:17:47.766084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c0db99ea-e8a7-44e1-bf3c-4e6e879ff298 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1680 microversion: 2.1 time: 0.498785 Oct 23 02:17:47.766915 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 333/666] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:47 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1680 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:48.602211 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:48.604543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:48.611633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.612341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.612875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.613665 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.614187 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.614716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.635895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:48.650063 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-34c0d75c-6d4a-4ec0-9c6a-5784339742a6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052761 Oct 23 02:17:48.650839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 334/667] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:17:48 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 02:17:48.686069 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:48.688446 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:48.702633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.703163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.704273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.705438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.705883 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.706329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.730431 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:48.731135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:48.740995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.740995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.740995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.741615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.742070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.742515 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.772872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:48.782153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:48.790462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-86af80db-839d-4b19-bbd5-2fcece757278 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1329 microversion: 2.1 time: 0.108600 Oct 23 02:17:48.791105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 334/668] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:48 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1329 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:48.795862 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:48.796698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:48.803981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.804772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.805517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.811255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.811867 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.812305 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.899648 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-41606c74-dead-4014-b121-9c022b801f6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 204 len: 0 microversion: 2.1 time: 0.174428 Oct 23 02:17:48.900240 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 335/669] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:48 2022] DELETE /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:17:48.913077 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:48.914143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:48.922697 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.923396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.923965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:48.924891 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:48.925341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:48.925861 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:49.011048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:49.020824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-81b5018d-bced-4435-a664-ae2473926d9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1680 microversion: 2.1 time: 0.228378 Oct 23 02:17:49.021493 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 335/670] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:48 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:49.074472 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:49.082883 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f1fc27f9-7f3c-486c-9ebe-b57cadf23f8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1673 microversion: 2.1 time: 0.178309 Oct 23 02:17:49.083479 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 336/671] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:48 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:49.814621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:49.815262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:49.821592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:49.822072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:49.822540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:49.823226 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:49.823679 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:49.824102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:49.854512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:49.854992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:49.855426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:49.855869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lazy-loading 'fault' on Instance uuid 91fc5747-8451-4657-979e-570ad7e73b8b {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:49.898970 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:49.907048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3d3e1dbc-424a-4758-8180-55e1ab304066 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1334 microversion: 2.1 time: 0.095900 Oct 23 02:17:49.907768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 336/672] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:49 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:50.045836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:50.046338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:50.053413 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:50.053899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:50.054336 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:50.055053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:50.055511 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:50.055934 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:50.106537 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:50.107395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:50.114087 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:50.114621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:50.115121 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:50.116128 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:50.116954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:50.117506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:50.333785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:50.341818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6dd8222f-2937-472c-9cc3-a940d97498f5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1680 microversion: 2.1 time: 0.299891 Oct 23 02:17:50.342506 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 337/673] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:50 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1680 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:50.397568 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:50.408182 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-02532dd6-71cb-485b-8f4c-7ca825700da2 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1673 microversion: 2.1 time: 0.305525 Oct 23 02:17:50.408803 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 337/674] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:50 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1673 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:50.931784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:50.932393 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:50.945261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:50.946073 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:50.946881 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:50.948106 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:50.948808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:50.949573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:50.989552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:50.989997 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:50.990530 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:50.990889 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lazy-loading 'fault' on Instance uuid 91fc5747-8451-4657-979e-570ad7e73b8b {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:51.068482 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:51.070355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:51.070355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:51.076881 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2869b692-87cb-44c0-83cb-be3452fa79f8 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 200 len: 1334 microversion: 2.1 time: 0.150432 Oct 23 02:17:51.077305 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.078621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.079409 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.080365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.081030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.081645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.095582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 338/675] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:50 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 1334 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:51.121074 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lazy-loading 'flavor' on Instance uuid 63e059be-46de-46ff-bbf2-55cb5c6b72ad {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:51.192389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:51.214417 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-12389d6d-5769-4282-8e0d-9ba7e24e1d62 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "POST /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad/action" status: 202 len: 0 microversion: 2.1 time: 0.150227 Oct 23 02:17:51.215100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 338/676] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:17:51 2022] POST /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:17:51.226385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:51.227120 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:51.234559 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.235816 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.237469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.239269 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.240527 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.241338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.367745 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:51.368512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:51.375693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.376528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.377141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.378040 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.378720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.379328 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.495882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:51.515384 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a3c6f93b-77a0-4b31-983d-1c3fedad5eca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 200 len: 1613 microversion: 2.1 time: 0.151799 Oct 23 02:17:51.517321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 339/677] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:51 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 1613 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:51.523959 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:51.524882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:51.531336 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.532250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.533518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.534494 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.535187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.536387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.598477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:51.608082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bc0591eb-ba83-486b-a3fe-7e7ee01d31ed tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.387129 Oct 23 02:17:51.610471 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 339/678] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:51 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:51.615995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-820e2f23-538d-43a8-bf79-7e413e2822ef req-070ffa23-5385-407a-8c48-5b1ebf728678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89425f0-1391-4e8f-9135-b292f96bbb8f", "name": "network-vif-deleted", "tag": "3575bee5-b894-41b6-ba5e-2cac0d91950d"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:51.628430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-820e2f23-538d-43a8-bf79-7e413e2822ef req-070ffa23-5385-407a-8c48-5b1ebf728678 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:51.629260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-820e2f23-538d-43a8-bf79-7e413e2822ef req-070ffa23-5385-407a-8c48-5b1ebf728678 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:51.629796 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-820e2f23-538d-43a8-bf79-7e413e2822ef req-070ffa23-5385-407a-8c48-5b1ebf728678 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:51.644423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-820e2f23-538d-43a8-bf79-7e413e2822ef req-070ffa23-5385-407a-8c48-5b1ebf728678 service nova] Creating event network-vif-deleted:3575bee5-b894-41b6-ba5e-2cac0d91950d for instance d89425f0-1391-4e8f-9135-b292f96bbb8f on hv-cinder-86149 Oct 23 02:17:51.650659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-820e2f23-538d-43a8-bf79-7e413e2822ef req-070ffa23-5385-407a-8c48-5b1ebf728678 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038421 Oct 23 02:17:51.651483 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 340/679] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:51.810378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:51.821395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9a5da7a6-2632-4ef1-8f37-97d10ae91372 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1673 microversion: 2.1 time: 0.302826 Oct 23 02:17:51.822773 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 340/680] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:51 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:52.102510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:52.103214 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 91fc5747-8451-4657-979e-570ad7e73b8b] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:52.110823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.111746 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.112205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.112925 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.113387 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.113815 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.129027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] HTTP exception thrown: Instance 91fc5747-8451-4657-979e-570ad7e73b8b could not be found. Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Request method failure captured: Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b HTTP/1.1 Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLTOhI2m3mC7wlIqd4CYp_smt7j-uUYTHtphx3tpP-_pKnVPURgJoWW71reomIvkE2qFOSd-STCx1RUAT7e40Y1Ze6pHTvgD4ydMa-n6L3tJdeVRqrwiep-_GtviydtY9KdggIAflNA-tUJ8-6E384vIlw5sc3c_rNbZyiToR1MqDc Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:17:52.130462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 2335878ea1d045858b158f6b4175e896 Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 91fc5747-8451-4657-979e-570ad7e73b8b could not be found. Oct 23 02:17:52.131696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '91fc5747-8451-4657-979e-570ad7e73b8b'} Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91fc5747-8451-4657-979e-570ad7e73b8b could not be found. Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:52.132768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91fc5747-8451-4657-979e-570ad7e73b8b could not be found. Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91fc5747-8451-4657-979e-570ad7e73b8b could not be found. Oct 23 02:17:52.133921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.134966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Returning 404 to user: Instance 91fc5747-8451-4657-979e-570ad7e73b8b could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:52.134966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7f2e993c-5a27-492d-9cd4-130b8d018047 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b" status: 404 len: 111 microversion: 2.1 time: 0.034518 Oct 23 02:17:52.136354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 341/681] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:52 2022] GET /compute/v2.1/servers/91fc5747-8451-4657-979e-570ad7e73b8b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:52.141341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5bbb9501-1f2b-4a78-be49-d80592d4057d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '.version_select at 0x7f9da2ea7700>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:52.163120 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5bbb9501-1f2b-4a78-be49-d80592d4057d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297625521" status: 202 len: 0 microversion: 2.1 time: 0.025374 Oct 23 02:17:52.163701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 341/682] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 23 02:17:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297625521 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:17:52.541295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:52.541928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:52.561796 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.570471 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.573863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.578690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.579978 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.580433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.602201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f HTTP/1.1 Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:17:52.604253 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:17:52.605806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'd89425f0-1391-4e8f-9135-b292f96bbb8f'} Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:52.606668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:17:52.608128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:17:52.611391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:52.612787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-60fe1770-114c-469b-bb4e-5bbe88be7805 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 404 len: 111 microversion: 2.1 time: 0.075817 Oct 23 02:17:52.617417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 342/683] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:52 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:17:52.624257 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4e492c2b-b82d-4722-8c3f-3cf7604585cb tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '.version_select at 0x7f9da2e62310>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:52.642539 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:52.644700 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:52.661879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.662380 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.662884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.664017 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.664970 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.665449 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.677535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4e492c2b-b82d-4722-8c3f-3cf7604585cb tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-982297247" status: 202 len: 0 microversion: 2.1 time: 0.059076 Oct 23 02:17:52.681571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 342/684] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 23 02:17:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-982297247 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:17:52.847995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:52.848608 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:52.860180 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.860985 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.863934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.864879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.865519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.866116 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.876603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:52.886155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-39a7891a-e19c-4395-86e5-c081cf7edfd1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.255486 Oct 23 02:17:52.887775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 343/685] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:52 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:52.927171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:52.927916 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:52.928506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:52.929105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lazy-loading 'fault' on Instance uuid 973e0362-0459-4084-9f53-776ba26a7fbf {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:52.979653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:52.992634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-54c54aeb-eb3a-4ead-9da8-34abb47cd475 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 200 len: 1327 microversion: 2.1 time: 0.149817 Oct 23 02:17:52.993376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 343/686] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:52 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 1327 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:53.602280 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c39729ff-97f4-4c4a-b7d0-a1bbbfbd6cc9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: .version_select at 0x7f9da2e8d790>, body: {"keypair": {"name": "tempest-keypair-300045846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJWL7K21c/AcYzRhmAKn/ME9pOyw2fyWLAkCUTWrDlwhX3SB3hnAB5jtvEstvEWPNAcBK7lBuy7I67ado2VcSW04c0iHb5X/0Bsy9K18xVeAriBTjJHAtvmRIyf+Yww6A=="}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:53.622143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-c39729ff-97f4-4c4a-b7d0-a1bbbfbd6cc9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:53.627342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-c39729ff-97f4-4c4a-b7d0-a1bbbfbd6cc9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for user 66975cf6d8fa417e8df429d4c89ef910 and project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:53.661523 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c39729ff-97f4-4c4a-b7d0-a1bbbfbd6cc9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063128 Oct 23 02:17:53.668335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 344/687] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:17:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:53.707853 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-0a95abf0-9da6-4bc4-bbd9-11216c6ab049 req-a6bc9b0a-c6de-409d-9a36-b64ab32bafea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973e0362-0459-4084-9f53-776ba26a7fbf", "name": "network-vif-deleted", "tag": "54d0f82f-cd89-435a-91df-bd081d1c222c"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:53.717409 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0a95abf0-9da6-4bc4-bbd9-11216c6ab049 req-a6bc9b0a-c6de-409d-9a36-b64ab32bafea service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:53.717966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0a95abf0-9da6-4bc4-bbd9-11216c6ab049 req-a6bc9b0a-c6de-409d-9a36-b64ab32bafea service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:53.718569 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0a95abf0-9da6-4bc4-bbd9-11216c6ab049 req-a6bc9b0a-c6de-409d-9a36-b64ab32bafea service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:53.730880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-0a95abf0-9da6-4bc4-bbd9-11216c6ab049 req-a6bc9b0a-c6de-409d-9a36-b64ab32bafea service nova] Creating event network-vif-deleted:54d0f82f-cd89-435a-91df-bd081d1c222c for instance 973e0362-0459-4084-9f53-776ba26a7fbf on hv-cinder-86149 Oct 23 02:17:53.736252 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-0a95abf0-9da6-4bc4-bbd9-11216c6ab049 req-a6bc9b0a-c6de-409d-9a36-b64ab32bafea service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033793 Oct 23 02:17:53.736929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 344/688] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:53.914534 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:53.915273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:53.921275 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:53.922538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:53.923262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:53.924038 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:53.924501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:53.924934 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:54.017477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:54.018560 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:54.025405 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:54.026117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:54.026975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:54.027859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:54.028500 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:54.028992 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:54.049956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] HTTP exception thrown: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Request method failure captured: Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf HTTP/1.1 Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLO_aoz5p5bXVEqg0WZvSqMbBxiyCqihYhh7dAVux3NfBK8OJja3daTauj7cALj8EwXC4tqR_I-5hgMjlGa7IKCiY_swwkLDnxKT8TRD_Lz94ToI2AZt6Or6F5h640urVOudgJHHpyXCzvCJmfBganf4n4D-Hrj9Oe5r8RZGNu_g1M Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:17:54.052847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 006623bab8f04f448edf0d43397192d8 Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:17:54.054523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '973e0362-0459-4084-9f53-776ba26a7fbf'} Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:17:54.055563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:17:54.056901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:17:54.058193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Returning 404 to user: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:17:54.058193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ba5f236f-f1e1-4065-ba30-f325afed4f2f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 404 len: 111 microversion: 2.1 time: 0.044824 Oct 23 02:17:54.058193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 345/689] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:54 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:17:54.069273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-61bd7689-2557-444d-92e9-70e69fff83ef tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '.version_select at 0x7f9da2e1f9d0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:54.072905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:54.082040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6a8c9625-831e-462d-8554-40635d5ab5a1 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.171943 Oct 23 02:17:54.083064 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 345/690] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:53 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:54.088791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-61bd7689-2557-444d-92e9-70e69fff83ef tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-598909238" status: 202 len: 0 microversion: 2.1 time: 0.023690 Oct 23 02:17:54.089349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 346/691] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 23 02:17:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-598909238 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:17:54.787057 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-77f8d7b1-2747-4c1d-ad8f-7edf5f29a8ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'create', calling method: .version_select at 0x7f9da2edc040>, body: {"keypair": {"name": "tempest-keypair-1626503905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3LgZw5V+ia1KSckHPyPayHL/aQtj8DT8A2FwTLdelCNFRlBEBsBd9gF7X3l4fEN3NQjAFcrLHOPb8WtKJhXwoDkinpgLpGpjkKSWpRxa06xYKw40zGLtk68lqoVJA8JQ=="}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:54.803133 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-77f8d7b1-2747-4c1d-ad8f-7edf5f29a8ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Getting quotas for project 49a39f93e67c4d3f9529bdef5bb66b4c. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:54.807573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-77f8d7b1-2747-4c1d-ad8f-7edf5f29a8ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Getting quotas for user 006623bab8f04f448edf0d43397192d8 and project 49a39f93e67c4d3f9529bdef5bb66b4c. Resources: {'key_pairs'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:54.830247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-77f8d7b1-2747-4c1d-ad8f-7edf5f29a8ca tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046973 Oct 23 02:17:54.830886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 346/692] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:17:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:55.107808 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:55.110842 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:55.121559 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-523033648", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7b3cf49-41ec-4949-b12a-aff94c1d3d94"}], "security_groups": [{"name": "tempest-securitygroup--953885232"}], "key_name": "tempest-keypair-300045846", "user_data": "}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:55.121845 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:55.122332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:55.122858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:55.123700 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:55.124155 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:55.125143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:55.311734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] validate_networks() for [('a7b3cf49-41ec-4949-b12a-aff94c1d3d94', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:17:55.409625 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:55.418786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bc265d00-267d-4358-91bb-06779506143c tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.317368 Oct 23 02:17:55.419361 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 347/693] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:55 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:55.470863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:55.471511 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:55.482461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:55.483053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:55.483501 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:55.484739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:55.485198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:55.485719 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:55.512804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Going to try to terminate instance {{(pid=118877) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:17:55.599584 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-07ca7fcd-563e-40ca-8b00-9bd9a38a688d tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "DELETE /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 204 len: 0 microversion: 2.1 time: 0.132295 Oct 23 02:17:55.604715 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 348/694] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:17:55 2022] DELETE /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:17:55.610909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:55.611611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:55.617905 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:55.618400 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:55.618874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:55.619571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:55.620030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:55.620459 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:56.091045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:56.099341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-35cdc730-7c01-49c1-ba7a-fb8e8acaa393 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1507 microversion: 2.1 time: 0.493031 Oct 23 02:17:56.100014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 349/695] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:55 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:56.127549 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:17:56.127976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:17:56.128419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:17:56.128812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:17:56.129218 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:17:56.138257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:56.138769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:56.139203 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:56.139917 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:56.141400 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:56.141986 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:56.156481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:56.163386 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:56.168259 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for user 66975cf6d8fa417e8df429d4c89ef910 and project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:56.182768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1437926609", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d813ef1f-8211-49e2-a5ea-c7934e717ca1"}], "security_groups": [{"name": "tempest-securitygroup--1123279809"}], "key_name": "tempest-keypair-1626503905", "user_data": "}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:56.183288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:17:56.185499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:17:56.232157 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [c78d77f1-8fae-4dae-9368-6ab55a2c20a5] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:17:56.290739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] validate_networks() for [('d813ef1f-8211-49e2-a5ea-c7934e717ca1', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:17:56.666413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:17:56.666877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:17:56.667345 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:17:56.667781 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:17:56.668186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:17:56.677059 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:56.677532 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:56.677960 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:56.678728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:56.683468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:56.683468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:56.691593 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:17:56.698811 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Getting quotas for project 49a39f93e67c4d3f9529bdef5bb66b4c. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:17:56.704136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Getting quotas for user 006623bab8f04f448edf0d43397192d8 and project 49a39f93e67c4d3f9529bdef5bb66b4c. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:17:56.715453 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:17:56.717722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:17:56.764875 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-fefcec72-4dc7-4bf3-be5b-d4d79b077cb9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586461 Oct 23 02:17:56.766326 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 350/696] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:17:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:17:56.770595 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:56.771201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:56.778204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:56.778771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:56.779248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:56.779985 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:56.780481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:56.781768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:56.926187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:56.933982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9cbfc734-8afd-44d4-b60a-ec181e7364c5 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.166935 Oct 23 02:17:56.934565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 351/697] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:56 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:56.939633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e7b5f010-1c9e-467a-9172-9013e8f000fd tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:56.940232 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e7b5f010-1c9e-467a-9172-9013e8f000fd tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:56.999916 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e7b5f010-1c9e-467a-9172-9013e8f000fd tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:57.007190 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e7b5f010-1c9e-467a-9172-9013e8f000fd tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1238 microversion: 2.1 time: 0.071608 Oct 23 02:17:57.007819 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 352/698] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:56 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:57.122657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:57.123268 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:57.129194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:57.129672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:57.130104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:57.130818 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:57.131269 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:57.131717 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:57.241234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO oslo.messaging._drivers.impl_rabbit [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [c78d77f1-8fae-4dae-9368-6ab55a2c20a5] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 35972. Oct 23 02:17:57.245501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5e1eca76-c2b7-4c46-b5c3-916bd90d9ff6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.128535 Oct 23 02:17:57.246149 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 347/699] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:17:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:17:57.258055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-999c9665-5e3f-4c15-98c6-669c54da3039 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:57.258760 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-999c9665-5e3f-4c15-98c6-669c54da3039 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:57.271921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:57.281447 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b2e04ab6-c4ee-4c89-9fe8-4af7e8586f60 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1507 microversion: 2.1 time: 0.162298 Oct 23 02:17:57.282302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 353/700] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:57 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:57.317244 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-999c9665-5e3f-4c15-98c6-669c54da3039 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:57.324712 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-999c9665-5e3f-4c15-98c6-669c54da3039 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1240 microversion: 2.1 time: 0.070418 Oct 23 02:17:57.325501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 348/701] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:57 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:57.969893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-444250e0-a858-4aa5-ae25-3cec82304097 req-f984f33c-52ac-4fa4-8a03-05a042378e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933c0983-1ad5-4cbc-9004-2b6ce8ea7c62", "name": "network-vif-deleted", "tag": "d969c3a4-3cf5-438b-8549-4df01ca980f6"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:17:57.975917 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:57.976530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:57.987102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:57.987615 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:57.988052 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:57.988752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:57.989209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:57.989631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:58.003520 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-444250e0-a858-4aa5-ae25-3cec82304097 req-f984f33c-52ac-4fa4-8a03-05a042378e5e service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:58.003912 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-444250e0-a858-4aa5-ae25-3cec82304097 req-f984f33c-52ac-4fa4-8a03-05a042378e5e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:58.009278 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-444250e0-a858-4aa5-ae25-3cec82304097 req-f984f33c-52ac-4fa4-8a03-05a042378e5e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:58.032206 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-444250e0-a858-4aa5-ae25-3cec82304097 req-f984f33c-52ac-4fa4-8a03-05a042378e5e service nova] Creating event network-vif-deleted:d969c3a4-3cf5-438b-8549-4df01ca980f6 for instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 on hv-cinder-86149 Oct 23 02:17:58.041546 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-444250e0-a858-4aa5-ae25-3cec82304097 req-f984f33c-52ac-4fa4-8a03-05a042378e5e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075831 Oct 23 02:17:58.042136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 349/702] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:17:58.048279 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:58.048983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:58.055325 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:58.056103 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:58.056738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:58.057644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:58.058095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:58.058698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:58.136504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:58.144339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1a997fac-42cf-4731-8170-ca6e8ab9614c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1290 microversion: 2.1 time: 0.100872 Oct 23 02:17:58.145001 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 350/703] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:58 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:58.174319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:58.182089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b90ce5ba-c044-4fbb-a193-2b4c99fb46c7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.221751 Oct 23 02:17:58.182682 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 354/704] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:57 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:58.306358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:58.307186 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:58.317343 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:58.317837 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:58.318270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:58.319005 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:58.319454 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:58.319872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:58.392600 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:58.400493 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-41ac1370-4e12-43d4-96e9-8a4382c33ddc tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1292 microversion: 2.1 time: 0.097985 Oct 23 02:17:58.401643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 351/705] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:58 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:58.441342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:58.441942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:58.448162 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:58.448644 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:58.449203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:58.449793 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:58.450240 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:58.450709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:58.534109 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:58.542066 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0a90a824-bdd6-4070-b43b-b840bc9bdbab tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1292 microversion: 2.1 time: 0.196842 Oct 23 02:17:58.542912 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 355/706] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:58 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1292 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:59.168897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:59.169511 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:59.176748 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.177236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.177674 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.178367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.178848 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.179268 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.205027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:59.206571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:59.212725 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.213201 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.213623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.214304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.214777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.215193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.257978 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:59.267033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cd6aee9e-4510-40bd-94cd-1cc316318562 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1296 microversion: 2.1 time: 0.101954 Oct 23 02:17:59.267621 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 352/707] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:59 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:17:59.425677 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:59.427835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:59.435191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.436005 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.437966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.438806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.439482 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.440129 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.490493 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.490983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.492358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.492820 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lazy-loading 'fault' on Instance uuid 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:17:59.534623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:59.544872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-621d75d6-4efd-4dfe-be87-034e50d6cd4b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.344427 Oct 23 02:17:59.564010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 356/708] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:59 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:59.578828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:17:59.579795 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:17:59.587792 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.589251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.591287 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.592079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:17:59.592718 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:17:59.593835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:17:59.595232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:59.606847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9110c840-c26f-4570-a205-41b1b186b23a tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 200 len: 1311 microversion: 2.1 time: 0.185844 Oct 23 02:17:59.621635 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 353/709] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:59 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:17:59.700510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:17:59.709285 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8e07440d-1287-4196-9cf0-cd8c669bcfd8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1298 microversion: 2.1 time: 0.143082 Oct 23 02:17:59.710038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 357/710] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:17:59 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:00.293406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:00.294165 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:00.302267 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.303140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.303818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.304729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.305342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.305965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.574669 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:00.575286 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:00.582244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.582763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.583204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.583897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.584379 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.584784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.624268 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:00.631860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-32cb36b2-dfab-4f92-b9f6-694ffef7848e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.343599 Oct 23 02:18:00.632449 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 354/711] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:00 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:00.636836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:00.637429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:00.643167 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.643655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.644095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.644795 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.645256 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.645688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.650114 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:00.661408 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] HTTP exception thrown: Instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 could not be found. Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Request method failure captured: Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 HTTP/1.1 Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLTOhI2m3mC7wlIqd4CYp_smt7j-uUYTHtphx3tpP-_pKnVPURgJoWW71reomIvkE2qFOSd-STCx1RUAT7e40Y1Ze6pHTvgD4ydMa-n6L3tJdeVRqrwiep-_GtviydtY9KdggIAflNA-tUJ8-6E384vIlw5sc3c_rNbZyiToR1MqDc Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:18:00.663128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 2335878ea1d045858b158f6b4175e896 Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 could not be found. Oct 23 02:18:00.664389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '933c0983-1ad5-4cbc-9004-2b6ce8ea7c62'} Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 could not be found. Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:00.665098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 could not be found. Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 could not be found. Oct 23 02:18:00.666221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:00.667273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Returning 404 to user: Instance 933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:00.667273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1e2364a2-1458-4f01-a477-380b6f59bcb5 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62" status: 404 len: 111 microversion: 2.1 time: 0.031159 Oct 23 02:18:00.667273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 355/712] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:00 2022] GET /compute/v2.1/servers/933c0983-1ad5-4cbc-9004-2b6ce8ea7c62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:00.673886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:00.674388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:00.684047 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.684560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.685004 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.685747 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.686229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.686696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.713192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:18:00.790758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ba2f6831-2ab0-46eb-bf65-60703bc8d233 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "DELETE /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 204 len: 0 microversion: 2.1 time: 0.121161 Oct 23 02:18:00.791627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 356/713] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:18:00 2022] DELETE /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:18:00.797967 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:00.798192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:00.804232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.804713 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.805147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.805839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.806285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.806764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.922343 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:00.929946 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f8843b12-984d-4828-96f9-e2d1a542ca4c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1298 microversion: 2.1 time: 0.137510 Oct 23 02:18:00.930547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 357/714] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:00 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:00.942706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:00.942706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:00.943001 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.943491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.943962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:00.944655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:00.945103 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:00.945524 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:01.042298 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:01.050958 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4f1a4c65-082d-4918-b6c8-0a59c770dfec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.480186 Oct 23 02:18:01.051538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 358/715] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:00 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:01.314261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:01.322205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c260db9e-2979-4754-822a-b84f46a6d16c tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.390638 Oct 23 02:18:01.322838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 358/716] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:00 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:01.500924 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-13672cac-b2d6-4297-a124-41f2e9ebabc7 req-0f154b09-eaad-421a-8f6e-5c4df3488cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b94295f-bde2-4165-bd9a-4763ac31fd9a", "tag": "cc068410-7e76-4bd9-a360-1e98e4ff4392"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:01.510103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-13672cac-b2d6-4297-a124-41f2e9ebabc7 req-0f154b09-eaad-421a-8f6e-5c4df3488cd4 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:01.510611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-13672cac-b2d6-4297-a124-41f2e9ebabc7 req-0f154b09-eaad-421a-8f6e-5c4df3488cd4 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:01.511039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-13672cac-b2d6-4297-a124-41f2e9ebabc7 req-0f154b09-eaad-421a-8f6e-5c4df3488cd4 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:01.516174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:01.525604 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-13672cac-b2d6-4297-a124-41f2e9ebabc7 req-0f154b09-eaad-421a-8f6e-5c4df3488cd4 service nova] Creating event network-changed:cc068410-7e76-4bd9-a360-1e98e4ff4392 for instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a on hv-cinder-86149 Oct 23 02:18:01.536815 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-13672cac-b2d6-4297-a124-41f2e9ebabc7 req-0f154b09-eaad-421a-8f6e-5c4df3488cd4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039454 Oct 23 02:18:01.537977 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 359/717] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:01.655982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:01.656761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:01.663021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:01.663583 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:01.664116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:01.665014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:01.665477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:01.665907 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:01.800211 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:01.808311 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1b2b8773-ac0f-4e2c-9080-a9fcc5edc585 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.157121 Oct 23 02:18:01.808806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 359/718] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:01 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:01.955624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:01.956288 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:01.963719 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:01.964155 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:01.964627 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:01.965284 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:01.965725 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:01.966141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:02.075033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:02.075564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:02.081470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:02.081956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:02.082391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:02.083113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:02.083563 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:02.083992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:02.108048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:02.116438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-dac279f3-8019-483c-9b96-597ac93ec64c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.165657 Oct 23 02:18:02.117007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 360/719] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:01 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:02.346648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:02.347151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:02.353188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:02.353672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:02.354102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:02.354812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:02.355261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:02.355690 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:02.539046 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:02.546978 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3f0067f4-4d8a-4f7e-9dd4-a392037dee84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.475788 Oct 23 02:18:02.547644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 360/720] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:02 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:02.547782 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:02.556247 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a8e887e2-51a1-4048-b90c-e23cfebe5bbf tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.214745 Oct 23 02:18:02.556827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 361/721] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:02 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:02.832938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:02.833557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:02.839546 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:02.840032 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:02.840473 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:02.841165 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:02.841620 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:02.842049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:02.974767 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:02.984456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-66c854b3-5299-4f42-b578-116a638a9ed1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.154624 Oct 23 02:18:02.984655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 361/722] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:02 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:03.138640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:03.139256 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:03.146296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:03.146849 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:03.147605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:03.148362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:03.148904 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:03.149355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:03.403866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:03.411687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-44b8fab4-f70b-436c-9901-f9b250af5bc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.277024 Oct 23 02:18:03.412264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 362/723] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:03 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:03.571470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:03.572135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:03.579738 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:03.580137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:03.580286 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:03.580679 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:03.581139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:03.581417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:03.581875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:03.582303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:03.587325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:03.588019 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:03.588455 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:03.589165 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:03.589914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:03.590338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:04.105635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2335878ea1d045858b158f6b4175e896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ac3d840c9f41ea842b8f4935770f8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:04.119407 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-563c8b58-cc60-4801-a8fe-55c922628fb7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 200 len: 1523 microversion: 2.1 time: 0.544148 Oct 23 02:18:04.121619 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 363/724] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:03 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 1523 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:04.129221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:04.132683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:04.150721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:04.152576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:04.153255 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:04.154179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:04.155650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:04.156337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:04.208809 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:04.220560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-be92eee6-f269-4b41-89bd-01713068308a tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.653016 Oct 23 02:18:04.221245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 362/725] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:03 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:04.305831 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-8832230b-6205-4caa-a303-e4b5d13ee931 req-32a0b4db-cc81-43f5-9762-b8f05972e98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd282d6-75f6-4241-8c5b-d364c031db43", "name": "network-vif-deleted", "tag": "201fa2da-3990-492d-a724-016abaeaf38a"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:04.319743 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8832230b-6205-4caa-a303-e4b5d13ee931 req-32a0b4db-cc81-43f5-9762-b8f05972e98e service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:04.320258 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8832230b-6205-4caa-a303-e4b5d13ee931 req-32a0b4db-cc81-43f5-9762-b8f05972e98e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:04.320699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8832230b-6205-4caa-a303-e4b5d13ee931 req-32a0b4db-cc81-43f5-9762-b8f05972e98e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:04.334092 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-8832230b-6205-4caa-a303-e4b5d13ee931 req-32a0b4db-cc81-43f5-9762-b8f05972e98e service nova] Creating event network-vif-deleted:201fa2da-3990-492d-a724-016abaeaf38a for instance afd282d6-75f6-4241-8c5b-d364c031db43 on hv-cinder-86149 Oct 23 02:18:04.339818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-8832230b-6205-4caa-a303-e4b5d13ee931 req-32a0b4db-cc81-43f5-9762-b8f05972e98e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117397 Oct 23 02:18:04.340426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 363/726] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:04.434839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:04.435643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:04.443586 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:04.444152 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:04.444858 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:04.445652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:04.446340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:04.446789 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:04.667737 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:04.675474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f5abbbe6-b4a2-4f50-8a2d-61be0c3a8a4e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.552646 Oct 23 02:18:04.676040 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 364/727] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:04 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:04.761773 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:04.770819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a612acd9-675f-42b5-acd2-445aeee625c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.340066 Oct 23 02:18:04.782464 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 364/728] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:04 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:04.782640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-86e3b78c-7398-410d-8534-81552b080134 req-bba8d0a9-de87-4d2c-a9f9-34c4e3a6c11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb9b7c7-7380-423a-b0c5-43e7d775e9e7", "tag": "1cc48bf0-68f8-4f4c-ac88-de9210d7d765"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:04.783988 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-86e3b78c-7398-410d-8534-81552b080134 req-bba8d0a9-de87-4d2c-a9f9-34c4e3a6c11d service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:04.784463 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-86e3b78c-7398-410d-8534-81552b080134 req-bba8d0a9-de87-4d2c-a9f9-34c4e3a6c11d service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:04.784884 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-86e3b78c-7398-410d-8534-81552b080134 req-bba8d0a9-de87-4d2c-a9f9-34c4e3a6c11d service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:04.795570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-86e3b78c-7398-410d-8534-81552b080134 req-bba8d0a9-de87-4d2c-a9f9-34c4e3a6c11d service nova] Creating event network-changed:1cc48bf0-68f8-4f4c-ac88-de9210d7d765 for instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 on hv-cinder-86149 Oct 23 02:18:04.800441 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-86e3b78c-7398-410d-8534-81552b080134 req-bba8d0a9-de87-4d2c-a9f9-34c4e3a6c11d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Oct 23 02:18:04.801082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 365/729] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:05.145983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:05.146637 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] [instance: afd282d6-75f6-4241-8c5b-d364c031db43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:05.153417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:05.153996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:05.154536 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:05.155421 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:05.155878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:05.156308 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:05.170823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] HTTP exception thrown: Instance afd282d6-75f6-4241-8c5b-d364c031db43 could not be found. Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Request method failure captured: Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 HTTP/1.1 Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLTOhI2m3mC7wlIqd4CYp_smt7j-uUYTHtphx3tpP-_pKnVPURgJoWW71reomIvkE2qFOSd-STCx1RUAT7e40Y1Ze6pHTvgD4ydMa-n6L3tJdeVRqrwiep-_GtviydtY9KdggIAflNA-tUJ8-6E384vIlw5sc3c_rNbZyiToR1MqDc Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:18:05.172552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d7ac3d840c9f41ea842b8f4935770f8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: d7ac3d840c9f41ea842b8f4935770f8b Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1982541878 Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 2335878ea1d045858b158f6b4175e896 Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1982541878-project Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance afd282d6-75f6-4241-8c5b-d364c031db43 could not be found. Oct 23 02:18:05.173863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'afd282d6-75f6-4241-8c5b-d364c031db43'} Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd282d6-75f6-4241-8c5b-d364c031db43 could not be found. Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:05.174659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd282d6-75f6-4241-8c5b-d364c031db43 could not be found. Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd282d6-75f6-4241-8c5b-d364c031db43 could not be found. Oct 23 02:18:05.175873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:05.176902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] Returning 404 to user: Instance afd282d6-75f6-4241-8c5b-d364c031db43 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:05.176902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c2bcf75b-64b5-4fcd-a407-b12c05369ce7 tempest-ServerRescueNegativeTestJSON-1982541878 tempest-ServerRescueNegativeTestJSON-1982541878-project] 10.222.0.23 "GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43" status: 404 len: 111 microversion: 2.1 time: 0.031934 Oct 23 02:18:05.176902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 365/730] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:05 2022] GET /compute/v2.1/servers/afd282d6-75f6-4241-8c5b-d364c031db43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:05.246190 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:05.247316 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:05.256525 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:05.257141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:05.257657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:05.258667 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:05.259344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:05.259823 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:05.643497 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:05.652542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6adb32c3-1713-4d73-8094-6211eb14eaa9 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.411688 Oct 23 02:18:05.653115 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 366/731] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:05 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:05.699385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:05.700124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:05.708545 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:05.709067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:05.709659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:05.710531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:05.711112 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:05.711681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:05.801025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:05.801751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:05.808105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:05.808599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:05.809135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:05.809835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:05.810420 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:05.810872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:05.871443 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:05.880742 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d9adc9e6-2e3d-4e3a-beb6-23d5dec2ba8a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.186064 Oct 23 02:18:05.894980 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 366/732] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:05 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:05.959984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:05.968721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0393d18b-c225-4036-9eaa-6f3d6c23007f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.175315 Oct 23 02:18:05.969339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 367/733] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:05 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:06.680998 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:06.683015 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:06.685363 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:06.698519 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:06.699053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:06.699570 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:06.700359 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:06.700885 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:06.701387 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:06.864156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:06.872729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9afef018-ca3a-41a1-99bc-a34fbfc65415 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.195787 Oct 23 02:18:06.887160 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 367/734] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:06 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:06.906655 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:06.907914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:06.916028 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:06.924437 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:06.925021 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:06.925607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:06.926662 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:06.927188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:06.927683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:06.994157 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:06.995163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:07.004765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:07.005504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:07.006146 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=8 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:07.008181 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:07.012462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:07.013617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:07.015202 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:07.322198 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=16 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:07.633687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:07.644631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-dd176c16-cef9-461e-82fb-271158322d44 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.743206 Oct 23 02:18:07.665054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 368/735] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:06 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:07.689412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:07.697757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e48582f8-6ea7-413e-b3ad-fa2e4c221bb0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.708847 Oct 23 02:18:07.698341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 368/736] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:06 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:07.901478 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:07.902089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:07.908324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:07.908919 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:07.909229 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:07.909919 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:07.910394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:07.910846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:08.056509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:08.065877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d67ed995-fbdf-4777-ae55-725c2c35e495 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.167980 Oct 23 02:18:08.066637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 369/737] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:07 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:08.673033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:08.673798 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:08.688468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:08.688976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:08.689433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:08.690141 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:08.690790 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:08.691223 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:08.725549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:08.726472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:08.735547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:08.736191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:08.736719 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:08.737572 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:08.738250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:08.739094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:08.961232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:08.964160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:08.972695 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b0c34bee-2b2a-47a2-a460-0e7aff83abac tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.304293 Oct 23 02:18:08.973285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 369/738] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:08 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:08.974908 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f9af2561-33e5-4f93-9c49-896006959a0e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.255632 Oct 23 02:18:08.975469 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 370/739] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:08 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:09.091828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:09.093205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:09.099137 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:09.099626 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:09.100063 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:09.100757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:09.101273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:09.101636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:09.238944 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:09.246922 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b490e2d0-dcf5-4241-a730-6a94b9c2d8f7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.158991 Oct 23 02:18:09.247658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 370/740] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:09 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:09.998905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:10.001198 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:10.007964 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.008461 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.008899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.009623 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.010075 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.010897 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.075020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-eae5b763-1b0e-45f3-949c-89ac72ce0bc5 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Action: 'create', calling method: .version_select at 0x7f9da2d9a700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-176569358"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:10.153688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:10.161933 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-41e46ec7-5131-4f99-8785-20bd81980ee7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.167873 Oct 23 02:18:10.162523 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 371/741] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:09 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:10.167232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:10.168199 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:10.174805 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.175299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.175739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.176432 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.176889 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.177324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.181356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:10.320298 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:10.329674 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c71679e6-40d7-476d-867d-b0ffadde3977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.166188 Oct 23 02:18:10.330246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 372/742] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:10 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:10.345182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:10.345182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:10.345182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.345182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.345961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.345961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.345961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.346850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.393107 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-eae5b763-1b0e-45f3-949c-89ac72ce0bc5 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.457887 Oct 23 02:18:10.402710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 371/743] 10.222.0.23 () {60 vars in 1155 bytes} [Sun Oct 23 02:18:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 460 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 23 02:18:10.408694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-efac7950-e01d-4862-8d77-b70e77ff077a tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2fce9d0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:10.465671 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-efac7950-e01d-4862-8d77-b70e77ff077a tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046" status: 200 len: 344 microversion: 2.1 time: 0.061934 Oct 23 02:18:10.468552 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 372/744] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:10 2022] GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:10.520434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:10.528671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-938d65c3-7959-448e-bb36-b539894a1bf4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1568 microversion: 2.1 time: 0.197381 Oct 23 02:18:10.530704 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 373/745] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:10 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:10.551800 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:10.552545 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:10.559573 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.560140 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.561162 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.562015 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.562580 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.563070 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.606371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118877) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 02:18:10.692287 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a09ef71c-8e8a-4516-9130-b18a81200410 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "POST /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad/action" status: 202 len: 0 microversion: 2.1 time: 0.144521 Oct 23 02:18:10.693518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 373/746] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:18:10 2022] POST /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:18:10.708749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:10.709662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:10.713465 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-ce6d2d8b-43d6-453d-abdc-c1a5859dae60 req-dcd92f6b-bd35-47a4-8414-3ffaa9843261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e059be-46de-46ff-bbf2-55cb5c6b72ad", "name": "network-vif-unplugged", "status": "completed", "tag": "d232d5a5-a6d8-44ab-a498-c1ef3fea2467"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:10.717205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.718745 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.719652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.722918 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.723593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.724285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.726883 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-ce6d2d8b-43d6-453d-abdc-c1a5859dae60 req-dcd92f6b-bd35-47a4-8414-3ffaa9843261 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:10.727503 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-ce6d2d8b-43d6-453d-abdc-c1a5859dae60 req-dcd92f6b-bd35-47a4-8414-3ffaa9843261 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:10.728010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-ce6d2d8b-43d6-453d-abdc-c1a5859dae60 req-dcd92f6b-bd35-47a4-8414-3ffaa9843261 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:10.741777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-ce6d2d8b-43d6-453d-abdc-c1a5859dae60 req-dcd92f6b-bd35-47a4-8414-3ffaa9843261 service nova] Creating event network-vif-unplugged:d232d5a5-a6d8-44ab-a498-c1ef3fea2467 for instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad on hv-cinder-86149 Oct 23 02:18:10.747609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-ce6d2d8b-43d6-453d-abdc-c1a5859dae60 req-dcd92f6b-bd35-47a4-8414-3ffaa9843261 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040035 Oct 23 02:18:10.749517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 374/747] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:10.898634 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:10.905346 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bfa3c28d-1378-4cd4-ac42-9c196568fdc3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1576 microversion: 2.1 time: 0.206167 Oct 23 02:18:10.906418 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 374/748] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:10 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:11.187016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:11.187623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:11.193643 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:11.194115 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:11.194571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:11.195246 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:11.195689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:11.196099 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:11.345230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:11.353001 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-aadc2008-fe39-42b6-8709-56a9a8a43571 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.170838 Oct 23 02:18:11.353735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 375/749] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:11 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:11.356557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:11.357183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:11.363849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:11.364337 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:11.364777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:11.365533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:11.365992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:11.366420 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:11.482534 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-72d28d73-a290-4870-9dcd-cc64a1e11026 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2e52a60>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:11.537058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-72d28d73-a290-4870-9dcd-cc64a1e11026 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046" status: 200 len: 345 microversion: 2.1 time: 0.058467 Oct 23 02:18:11.537635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 376/750] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:11 2022] GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:11.550352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3118e8c9-f4a7-4c56-88d5-de62d801a493 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Action: 'create', calling method: .version_select at 0x7f9da2dea1f0>, body: {"snapshot": {"volume_id": "6d3429c9-532c-4314-9b31-89277332e046", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1612649125"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:11.662883 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:11.670908 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-14ff3678-84d9-4d62-b9d4-4b14c7b1f7a7 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.318317 Oct 23 02:18:11.671477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 375/751] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:11 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:11.718398 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3118e8c9-f4a7-4c56-88d5-de62d801a493 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.171674 Oct 23 02:18:11.719380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 377/752] 10.222.0.23 () {60 vars in 1162 bytes} [Sun Oct 23 02:18:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:11.730065 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4a3d658e-d809-414c-99ce-20e7dcaeed16 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da679c430>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:11.764222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4a3d658e-d809-414c-99ce-20e7dcaeed16 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 200 len: 287 microversion: 2.1 time: 0.037400 Oct 23 02:18:11.764888 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 376/753] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:11 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:11.776134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7b7401f7-bd40-4dfc-9268-952cee5a9202 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2e1f310>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:11.824659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7b7401f7-bd40-4dfc-9268-952cee5a9202 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.052323 Oct 23 02:18:11.825222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 378/754] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Oct 23 02:18:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:11.836866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-57b6278e-e516-46fa-bc72-f949b98b64a0 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2e9ed30>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:11.866197 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-57b6278e-e516-46fa-bc72-f949b98b64a0 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 200 len: 287 microversion: 2.1 time: 0.032960 Oct 23 02:18:11.866841 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 377/755] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:11 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:11.928899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:11.929535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:11.936278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:11.936756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:11.937186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:11.937865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:11.938315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:11.938766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:12.068210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:12.075954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b498d60f-dfd2-4557-98bb-a786a223f287 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1576 microversion: 2.1 time: 0.150826 Oct 23 02:18:12.076523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 379/756] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:11 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:12.376778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:12.377447 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:12.384485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:12.385057 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:12.385580 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:12.386362 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:12.386843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:12.387294 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:12.524670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:12.533277 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b3308777-1cc1-4f22-9ce7-6251fe56d56f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.161256 Oct 23 02:18:12.533839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 378/757] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:12 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:12.694467 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:12.695133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:12.702171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:12.702696 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:12.703178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:12.703877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:12.704335 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:12.704794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:12.837049 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:12.845618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0bf5224d-dc52-4e95-9e10-cd55cd80b977 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.155111 Oct 23 02:18:12.846180 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 380/758] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:12 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:12.880104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-50df5279-caaa-47c1-b351-da042a9fcd13 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da679c550>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:12.911326 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-50df5279-caaa-47c1-b351-da042a9fcd13 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 200 len: 287 microversion: 2.1 time: 0.034980 Oct 23 02:18:12.911869 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 379/759] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:12 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:13.099374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:13.099988 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:13.106515 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:13.107142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:13.108235 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:13.108950 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:13.109402 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:13.109895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:13.248262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:13.251760 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:13.256787 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-04a689a2-d554-43e6-8777-d08167779c52 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1576 microversion: 2.1 time: 0.161798 Oct 23 02:18:13.257345 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 381/760] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:13 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:13.556522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:13.557128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:13.563491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:13.563971 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:13.564400 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:13.565085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:13.565530 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:13.565949 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:13.703033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:13.711367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b6cdee6c-1f7e-410c-b978-fff2e83dcb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.159146 Oct 23 02:18:13.712112 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 380/761] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:13 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:13.869476 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:13.870082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:13.879288 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:13.879852 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:13.880309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:13.881094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:13.881545 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:13.881993 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:13.924779 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a4d3f519-ade4-4cb3-89d3-9ce806fc8706 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2e3c9d0>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:13.957090 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a4d3f519-ade4-4cb3-89d3-9ce806fc8706 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 200 len: 287 microversion: 2.1 time: 0.035890 Oct 23 02:18:13.957679 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 381/762] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:13 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:14.013137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:14.022074 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a0744010-3380-4ae7-909c-cbf38a4dbade tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.156877 Oct 23 02:18:14.022713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 382/763] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:13 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:14.281121 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:14.281770 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:14.288669 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:14.289288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:14.289736 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:14.290710 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:14.291172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:14.291686 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:14.430766 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:14.439207 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7bb03470-cd47-442e-9fc3-6f3dbd5a9693 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1576 microversion: 2.1 time: 0.162823 Oct 23 02:18:14.439774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 382/764] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:14 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:14.736107 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:14.736718 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:14.743027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:14.743841 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:14.744599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:14.745809 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:14.746683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:14.747484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:14.886091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:14.894153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-531d20f1-ac09-4fe8-b36a-fc2c9e31137d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.162993 Oct 23 02:18:14.894737 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 383/765] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:14 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:14.971122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a44245be-51f7-404f-bcab-b353450a41f4 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2e3c670>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:15.002614 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a44245be-51f7-404f-bcab-b353450a41f4 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 200 len: 287 microversion: 2.1 time: 0.036005 Oct 23 02:18:15.003178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 383/766] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:14 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:15.045645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:15.046252 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:15.052135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:15.052607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:15.053032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:15.053704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:15.054151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:15.054598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:15.187796 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:15.195392 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f17b65fc-911c-4805-b0e0-ce6d3326ae2a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.154050 Oct 23 02:18:15.195954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 384/767] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:15 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:15.462879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:15.463562 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:15.470151 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:15.470665 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:15.471099 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:15.471783 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:15.472231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:15.472653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:15.610302 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:15.617906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b365127f-b1b9-4788-9fad-3f16cae0f2ec tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1576 microversion: 2.1 time: 0.159513 Oct 23 02:18:15.618482 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 384/768] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:15 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:15.920398 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:15.921320 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:15.928484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:15.929045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:15.929624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:15.930524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:15.931172 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:15.931801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:15.997224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-15d14e2e-d171-45e9-93d0-54aaf69e9ca3 req-ea4654de-45a6-4769-a157-6a87b8b0e9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b94295f-bde2-4165-bd9a-4763ac31fd9a", "name": "network-vif-plugged", "status": "completed", "tag": "cc068410-7e76-4bd9-a360-1e98e4ff4392"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:16.012084 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-15d14e2e-d171-45e9-93d0-54aaf69e9ca3 req-ea4654de-45a6-4769-a157-6a87b8b0e9ad service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:16.012565 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-15d14e2e-d171-45e9-93d0-54aaf69e9ca3 req-ea4654de-45a6-4769-a157-6a87b8b0e9ad service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:16.013545 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-15d14e2e-d171-45e9-93d0-54aaf69e9ca3 req-ea4654de-45a6-4769-a157-6a87b8b0e9ad service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:16.025599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-15d14e2e-d171-45e9-93d0-54aaf69e9ca3 req-ea4654de-45a6-4769-a157-6a87b8b0e9ad service nova] Creating event network-vif-plugged:cc068410-7e76-4bd9-a360-1e98e4ff4392 for instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a on hv-cinder-86149 Oct 23 02:18:16.033162 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-15d14e2e-d171-45e9-93d0-54aaf69e9ca3 req-ea4654de-45a6-4769-a157-6a87b8b0e9ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047093 Oct 23 02:18:16.034036 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 385/769] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:16.045371 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4ba50736-f41c-46b0-be41-2cdd5a88c28e tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da679c4c0>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:16.084722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4ba50736-f41c-46b0-be41-2cdd5a88c28e tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 200 len: 287 microversion: 2.1 time: 0.049461 Oct 23 02:18:16.085451 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 386/770] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:16 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:16.090606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:16.099086 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f6d545b2-80ac-4fa0-bf27-ef4a2e25dcf4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.184028 Oct 23 02:18:16.099906 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 385/771] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:15 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:16.219869 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:16.220594 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:16.226755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:16.227232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:16.227694 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:16.228376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:16.228822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:16.229242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:16.368615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:16.377924 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3050f7d5-482d-4f43-bdc5-9631ea746842 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.162265 Oct 23 02:18:16.378886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 387/772] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:16 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:16.641184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:16.641843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:16.648424 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:16.648961 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:16.649416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:16.650160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:16.650665 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:16.651127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:16.788289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:16.796605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a318ef78-a158-4fdf-ab08-c5f1a8307a85 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1518 microversion: 2.1 time: 0.159906 Oct 23 02:18:16.797166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 386/773] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:16 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:17.097906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-469166dd-9f2d-48ef-8338-fc43da02c266 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2e3c280>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:17.125238 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:17.125859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:17.130145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-469166dd-9f2d-48ef-8338-fc43da02c266 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 200 len: 288 microversion: 2.1 time: 0.036169 Oct 23 02:18:17.130815 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 388/774] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:17 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:17.134127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:17.134781 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:17.135316 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:17.136106 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:17.136639 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:17.137206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:17.142141 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a139c5fd-f090-4e93-b9b7-56112e79c45e tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2e9ea60>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:17.222400 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a139c5fd-f090-4e93-b9b7-56112e79c45e tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 202 len: 0 microversion: 2.1 time: 0.084022 Oct 23 02:18:17.223070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 389/775] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 23 02:18:17 2022] DELETE /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:18:17.231667 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-41891fda-1660-4a6d-89d9-cc6b23f9f1f4 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da679cee0>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:17.263687 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-41891fda-1660-4a6d-89d9-cc6b23f9f1f4 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 200 len: 287 microversion: 2.1 time: 0.035640 Oct 23 02:18:17.264378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 390/776] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:17 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:17.291553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:17.299253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-384d675f-e624-49c8-af66-1e2d432d373e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.178082 Oct 23 02:18:17.299812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 387/777] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:17 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:17.403422 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:17.404808 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:17.411169 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:17.411655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:17.412127 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:17.412893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:17.413353 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:17.413782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:17.551850 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:17.560909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-eaa1631a-e11a-4e30-ab2a-322aec940642 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.161692 Oct 23 02:18:17.561478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 391/778] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:17 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:17.820886 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:17.821762 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:17.829234 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:17.829795 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:17.830360 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:17.831181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:17.831784 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:17.832729 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:17.978112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:17.987485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-35cefd8b-6d9a-4503-aefe-a8ff6b41ee9e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1518 microversion: 2.1 time: 0.171316 Oct 23 02:18:17.999416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 388/779] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:17 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:18.276861 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-457be01b-cd82-46a0-8c75-d593702cc24a tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da679c160>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:18.303174 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-457be01b-cd82-46a0-8c75-d593702cc24a tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] HTTP exception thrown: Snapshot 0b34405b-c1c9-4e3d-97f8-c53950c08c7f could not be found. Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-457be01b-cd82-46a0-8c75-d593702cc24a tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Request method failure captured: Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f HTTP/1.1 Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKRhiAbCPjsXmhZyeURNfmsU4gQML9VY5j9GXfVf8z-zvzNPPo8fvJ9f5swnZk8eiFtsvtjEGCyw2HBVxdqdDPaGj8hMlixOtbbVRLKqAQ5sqXcsp9pvlB-4S0-Fr8ANavC2XVsVYcmOGyCTbNzbYCJArlVYhZO2uCDiN7ezVKkJ81E Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: a29518c15f6e4b75a63ae696827c6db2 Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:18:18.306402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: a29518c15f6e4b75a63ae696827c6db2 Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-VolumesSnapshotsTestJSON-1755811958-project Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 32a2abd2e7be48f9b42ef80fa73eb2bf Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1755811958-project Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Snapshot 0b34405b-c1c9-4e3d-97f8-c53950c08c7f could not be found. Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '0b34405b-c1c9-4e3d-97f8-c53950c08c7f'} Oct 23 02:18:18.308124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0b34405b-c1c9-4e3d-97f8-c53950c08c7f could not be found. (HTTP 404) (Request-ID: req-7a0e5532-237a-4934-904e-689489590acc) Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:18.309212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:18:18.310932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0b34405b-c1c9-4e3d-97f8-c53950c08c7f could not be found. Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 23 02:18:18.312409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0b34405b-c1c9-4e3d-97f8-c53950c08c7f could not be found. Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0b34405b-c1c9-4e3d-97f8-c53950c08c7f could not be found. Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-457be01b-cd82-46a0-8c75-d593702cc24a tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Returning 404 to user: Snapshot 0b34405b-c1c9-4e3d-97f8-c53950c08c7f could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:18.314050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-457be01b-cd82-46a0-8c75-d593702cc24a tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f" status: 404 len: 111 microversion: 2.1 time: 0.034999 Oct 23 02:18:18.314942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 392/780] 10.222.0.23 () {58 vars in 1251 bytes} [Sun Oct 23 02:18:18 2022] GET /compute/v2.1/os-snapshots/0b34405b-c1c9-4e3d-97f8-c53950c08c7f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:18.317502 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c3b03dd1-7239-4ea4-ad6b-d079d850d30b tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2ea7c10>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:18.320557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:18.321173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:18.328180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:18.328674 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:18.329115 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:18.329819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:18.330280 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:18.330742 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:18.381335 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c3b03dd1-7239-4ea4-ad6b-d079d850d30b tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046" status: 202 len: 0 microversion: 2.1 time: 0.067557 Oct 23 02:18:18.381903 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 389/781] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:18:18 2022] DELETE /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:18:18.390960 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ab3d89fe-c99e-4a98-9847-6ec7815893d6 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2d9a4c0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:18.444736 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ab3d89fe-c99e-4a98-9847-6ec7815893d6 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046" status: 200 len: 344 microversion: 2.1 time: 0.057983 Oct 23 02:18:18.445300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 390/782] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:18 2022] GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:18.467750 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:18.475408 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-60a72b33-1a0a-400c-abef-1205fd3407f8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.158492 Oct 23 02:18:18.475961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 393/783] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:18 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:18.586798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:18.587492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:18.595222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:18.596380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:18.596826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:18.597554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:18.598204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:18.598674 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:18.741578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:18.750534 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cd02e44b-9175-467f-bb8e-75df8fb95fed tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1364 microversion: 2.1 time: 0.167769 Oct 23 02:18:18.751111 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 391/784] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:18 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:19.013145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:19.013882 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:19.020864 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:19.021664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:19.022200 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:19.022922 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:19.023455 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:19.023974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:19.156481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:19.164312 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a64b25ee-a243-4fa8-90b1-001d215e41bd tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.155481 Oct 23 02:18:19.164877 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 394/785] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:19 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:19.460754 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dab883ea-2932-4989-a978-a335ab5866f5 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2ea7b80>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:19.492704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-dab883ea-2932-4989-a978-a335ab5866f5 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] HTTP exception thrown: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dab883ea-2932-4989-a978-a335ab5866f5 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Request method failure captured: Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 HTTP/1.1 Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKRhiAbCPjsXmhZyeURNfmsU4gQML9VY5j9GXfVf8z-zvzNPPo8fvJ9f5swnZk8eiFtsvtjEGCyw2HBVxdqdDPaGj8hMlixOtbbVRLKqAQ5sqXcsp9pvlB-4S0-Fr8ANavC2XVsVYcmOGyCTbNzbYCJArlVYhZO2uCDiN7ezVKkJ81E Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: a29518c15f6e4b75a63ae696827c6db2 Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:18:19.494893 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: a29518c15f6e4b75a63ae696827c6db2 Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesSnapshotsTestJSON-1755811958-project Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 32a2abd2e7be48f9b42ef80fa73eb2bf Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1755811958-project Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '6d3429c9-532c-4314-9b31-89277332e046'} Oct 23 02:18:19.496583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. (HTTP 404) (Request-ID: req-2e20aca7-eb60-42cb-a095-c47fe8748dca) Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.498220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:18:19.499702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 02:18:19.501131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dab883ea-2932-4989-a978-a335ab5866f5 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Returning 404 to user: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-dab883ea-2932-4989-a978-a335ab5866f5 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046" status: 404 len: 109 microversion: 2.1 time: 0.039939 Oct 23 02:18:19.502541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 392/786] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:19 2022] GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:19.503925 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:19.504656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:19.508376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1d4d9dbd-d43f-4284-8883-00e55776b141 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2df71f0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:19.511573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:19.511993 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:19.512508 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:19.513406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:19.514237 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:19.514433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:19.541411 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-1d4d9dbd-d43f-4284-8883-00e55776b141 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] HTTP exception thrown: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1d4d9dbd-d43f-4284-8883-00e55776b141 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Request method failure captured: Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 HTTP/1.1 Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKRhiAbCPjsXmhZyeURNfmsU4gQML9VY5j9GXfVf8z-zvzNPPo8fvJ9f5swnZk8eiFtsvtjEGCyw2HBVxdqdDPaGj8hMlixOtbbVRLKqAQ5sqXcsp9pvlB-4S0-Fr8ANavC2XVsVYcmOGyCTbNzbYCJArlVYhZO2uCDiN7ezVKkJ81E Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: a29518c15f6e4b75a63ae696827c6db2 Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:18:19.543626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: a29518c15f6e4b75a63ae696827c6db2 Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesSnapshotsTestJSON-1755811958-project Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 32a2abd2e7be48f9b42ef80fa73eb2bf Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1755811958-project Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '6d3429c9-532c-4314-9b31-89277332e046'} Oct 23 02:18:19.545676 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. (HTTP 404) (Request-ID: req-fa0558d2-f662-49e1-84b1-4996a326f7cd) Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.547072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 02:18:19.548403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 02:18:19.549942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1d4d9dbd-d43f-4284-8883-00e55776b141 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Returning 404 to user: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1d4d9dbd-d43f-4284-8883-00e55776b141 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046" status: 404 len: 109 microversion: 2.1 time: 0.043014 Oct 23 02:18:19.551605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 393/787] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:18:19 2022] DELETE /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:19.556150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f6610eef-2d8d-4050-8b23-b252794cd621 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Calling method '.version_select at 0x7f9da2dad700>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:19.584137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-f6610eef-2d8d-4050-8b23-b252794cd621 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] HTTP exception thrown: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f6610eef-2d8d-4050-8b23-b252794cd621 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Request method failure captured: Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 HTTP/1.1 Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKRhiAbCPjsXmhZyeURNfmsU4gQML9VY5j9GXfVf8z-zvzNPPo8fvJ9f5swnZk8eiFtsvtjEGCyw2HBVxdqdDPaGj8hMlixOtbbVRLKqAQ5sqXcsp9pvlB-4S0-Fr8ANavC2XVsVYcmOGyCTbNzbYCJArlVYhZO2uCDiN7ezVKkJ81E Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: a29518c15f6e4b75a63ae696827c6db2 Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:18:19.586202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a29518c15f6e4b75a63ae696827c6db2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: a29518c15f6e4b75a63ae696827c6db2 Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1755811958 Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesSnapshotsTestJSON-1755811958-project Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 32a2abd2e7be48f9b42ef80fa73eb2bf Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1755811958-project Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '6d3429c9-532c-4314-9b31-89277332e046'} Oct 23 02:18:19.587498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. (HTTP 404) (Request-ID: req-4e23effe-9298-4576-b988-28925e06c40c) Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.588359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:18:19.589686 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 02:18:19.591054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f6610eef-2d8d-4050-8b23-b252794cd621 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] Returning 404 to user: Volume 6d3429c9-532c-4314-9b31-89277332e046 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f6610eef-2d8d-4050-8b23-b252794cd621 tempest-VolumesSnapshotsTestJSON-1755811958 tempest-VolumesSnapshotsTestJSON-1755811958-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046" status: 404 len: 109 microversion: 2.1 time: 0.035414 Oct 23 02:18:19.592356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 394/788] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:19 2022] GET /compute/v2.1/os-volumes/6d3429c9-532c-4314-9b31-89277332e046 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:19.743315 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:19.751524 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e7e13a1d-2dc8-4b4c-810d-0888dc09a454 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.256850 Oct 23 02:18:19.752109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 395/789] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:19 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:19.777553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:19.779663 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:19.786189 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:19.786331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:19.786866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:19.787570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:19.788023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:19.788451 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:20.018403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-d0802b3e-4ddc-4453-ac90-e62025c7b489 req-b1a79918-5267-416e-b3aa-6638a1955518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb9b7c7-7380-423a-b0c5-43e7d775e9e7", "name": "network-vif-plugged", "status": "completed", "tag": "1cc48bf0-68f8-4f4c-ac88-de9210d7d765"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:20.030373 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-d0802b3e-4ddc-4453-ac90-e62025c7b489 req-b1a79918-5267-416e-b3aa-6638a1955518 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:20.030971 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-d0802b3e-4ddc-4453-ac90-e62025c7b489 req-b1a79918-5267-416e-b3aa-6638a1955518 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:20.031480 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-d0802b3e-4ddc-4453-ac90-e62025c7b489 req-b1a79918-5267-416e-b3aa-6638a1955518 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:20.043331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:20.045339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-d0802b3e-4ddc-4453-ac90-e62025c7b489 req-b1a79918-5267-416e-b3aa-6638a1955518 service nova] Creating event network-vif-plugged:1cc48bf0-68f8-4f4c-ac88-de9210d7d765 for instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 on hv-cinder-86149 Oct 23 02:18:20.051363 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-d0802b3e-4ddc-4453-ac90-e62025c7b489 req-b1a79918-5267-416e-b3aa-6638a1955518 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038960 Oct 23 02:18:20.052351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ccb979a3-d88a-45cb-91cc-8075ade24e6a tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1551 microversion: 2.1 time: 0.279406 Oct 23 02:18:20.052839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 396/790] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:20.053012 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 395/791] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:19 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1551 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:20.076383 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:20.077082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:20.083491 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:20.084236 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:20.084834 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:20.085705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:20.086315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:20.086920 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:20.175425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bb6be080-4013-4c8c-a485-3746f954bc0c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103287 Oct 23 02:18:20.176586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 396/792] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 23 02:18:20 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:20.188048 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:20.189041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:20.194943 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:20.197180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:20.198188 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:20.199239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:20.200744 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:20.201599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:20.202194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:20.484491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:20.493692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-43344dc0-9c9a-4fb8-8f81-06b646e10045 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.309862 Oct 23 02:18:20.494498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 397/793] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:20 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:20.776938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:20.777540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:20.785127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:20.796981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:20.797524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:20.798342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:20.798931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:20.799351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:21.050058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:21.057785 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bfc8e130-2994-4d6d-ab68-36e58c880efd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.286528 Oct 23 02:18:21.071043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 397/794] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:20 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:21.519249 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:21.520690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:21.527673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:21.528412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:21.528999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:21.529768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:21.530257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:21.530712 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:21.697135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-accaecb1-6c0d-42bf-9000-b4f6e7d4f6b5 req-9c9b83a6-4fb4-40c7-89db-d5632e9facff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b94295f-bde2-4165-bd9a-4763ac31fd9a", "tag": "cc068410-7e76-4bd9-a360-1e98e4ff4392"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:21.707994 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-accaecb1-6c0d-42bf-9000-b4f6e7d4f6b5 req-9c9b83a6-4fb4-40c7-89db-d5632e9facff service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:21.708473 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-accaecb1-6c0d-42bf-9000-b4f6e7d4f6b5 req-9c9b83a6-4fb4-40c7-89db-d5632e9facff service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:21.708904 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-accaecb1-6c0d-42bf-9000-b4f6e7d4f6b5 req-9c9b83a6-4fb4-40c7-89db-d5632e9facff service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:21.719586 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:21.720983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-accaecb1-6c0d-42bf-9000-b4f6e7d4f6b5 req-9c9b83a6-4fb4-40c7-89db-d5632e9facff service nova] Creating event network-changed:cc068410-7e76-4bd9-a360-1e98e4ff4392 for instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a on hv-cinder-86149 Oct 23 02:18:21.726520 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-accaecb1-6c0d-42bf-9000-b4f6e7d4f6b5 req-9c9b83a6-4fb4-40c7-89db-d5632e9facff service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040765 Oct 23 02:18:21.727121 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 398/795] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:21.728549 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d96beae2-e087-44dd-a704-a3423b8c4f7b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.213611 Oct 23 02:18:21.729199 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 398/796] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:21 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:22.083031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:22.083756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:22.089838 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:22.090324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:22.091354 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:22.092152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:22.092608 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:22.093029 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:22.228777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:22.237349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5004d3fe-0c21-49bc-af45-ef243768f60c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1365 microversion: 2.1 time: 0.159109 Oct 23 02:18:22.237922 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 399/797] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:22 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:22.554755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b794bce9-185c-40bf-b98b-e89a042303bc tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2e3cee0>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:22.611016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b794bce9-185c-40bf-b98b-e89a042303bc tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1e36951b-66ab-431d-930c-e20fb2650f24" status: 200 len: 350 microversion: 2.1 time: 0.060096 Oct 23 02:18:22.611583 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 399/798] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:22 2022] GET /compute/v2.1/os-volumes/1e36951b-66ab-431d-930c-e20fb2650f24 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:22.755766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:22.756623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:22.764251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:22.764929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:22.765436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:22.766207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:22.766922 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:22.767318 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:22.990069 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:22.999880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f8cf12a6-1156-4408-ae77-6056413ae315 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.249333 Oct 23 02:18:23.000555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 400/799] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:22 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:23.261140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:23.261772 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:23.268392 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:23.268872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:23.269365 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:23.270039 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:23.270525 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:23.271212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:23.470863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:23.478637 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7c4efa87-789b-4f38-84d3-df27f0ef681b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1556 microversion: 2.1 time: 0.221410 Oct 23 02:18:23.479208 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 400/800] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:23 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1556 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:23.503098 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:23.503653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:23.510363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:23.510895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:23.511326 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:23.512019 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:23.512482 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:23.512891 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:23.589550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6577cdb5-9516-48e4-a9a2-98f7430ce7cc tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090289 Oct 23 02:18:23.590140 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 401/801] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 23 02:18:23 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:24.023175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:24.023896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:24.024504 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b1ed1995-6e6c-451b-972f-8988145a2473 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2e1fca0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:24.031195 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:24.031773 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:24.032288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:24.035498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:24.035978 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:24.036589 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:24.040857 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:24.081809 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b1ed1995-6e6c-451b-972f-8988145a2473 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/fed65693-bc8f-4087-93a2-6c2a8fe3552e" status: 200 len: 351 microversion: 2.1 time: 0.061495 Oct 23 02:18:24.082375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 402/802] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:24 2022] GET /compute/v2.1/os-volumes/fed65693-bc8f-4087-93a2-6c2a8fe3552e => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:18:24.264895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:24.274501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3977ea90-bf0f-4efc-9103-4a50ab6d16af tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.255513 Oct 23 02:18:24.275158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 401/803] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:24 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:18:24.627670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-45cfc0b0-aa93-489f-b828-f2c4132e9d9c req-0d0ed6fa-047f-4075-9b8d-e337f33dffe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb9b7c7-7380-423a-b0c5-43e7d775e9e7", "tag": "1cc48bf0-68f8-4f4c-ac88-de9210d7d765"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:24.632568 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:24.639150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-45cfc0b0-aa93-489f-b828-f2c4132e9d9c req-0d0ed6fa-047f-4075-9b8d-e337f33dffe6 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:24.639624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-45cfc0b0-aa93-489f-b828-f2c4132e9d9c req-0d0ed6fa-047f-4075-9b8d-e337f33dffe6 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:24.640051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-45cfc0b0-aa93-489f-b828-f2c4132e9d9c req-0d0ed6fa-047f-4075-9b8d-e337f33dffe6 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:24.651867 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-45cfc0b0-aa93-489f-b828-f2c4132e9d9c req-0d0ed6fa-047f-4075-9b8d-e337f33dffe6 service nova] Creating event network-changed:1cc48bf0-68f8-4f4c-ac88-de9210d7d765 for instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 on hv-cinder-86149 Oct 23 02:18:24.657327 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-45cfc0b0-aa93-489f-b828-f2c4132e9d9c req-0d0ed6fa-047f-4075-9b8d-e337f33dffe6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034526 Oct 23 02:18:24.657914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 403/804] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:25.301336 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:25.301949 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:25.308385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:25.309020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:25.310252 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:25.310854 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:25.311318 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:25.311775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:25.453787 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7fb0d96c-9db0-471f-931f-a5c1b27ede06 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2df78b0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:25.466135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:25.478917 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-40f74bbf-853b-4b3c-95ce-985454f29905 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.181355 Oct 23 02:18:25.479570 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 402/805] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:25 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:25.521227 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7fb0d96c-9db0-471f-931f-a5c1b27ede06 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/151bff2a-1998-45f3-9aee-6e9607797a82" status: 200 len: 350 microversion: 2.1 time: 0.072395 Oct 23 02:18:25.522478 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 404/806] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:25 2022] GET /compute/v2.1/os-volumes/151bff2a-1998-45f3-9aee-6e9607797a82 => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:25.536085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9351611b-34bc-47ed-87b3-07783e7fa5fd tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2ee3940>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:25.626198 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9351611b-34bc-47ed-87b3-07783e7fa5fd tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094077 Oct 23 02:18:25.627186 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 403/807] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 23 02:18:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:25.642330 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2ee9d1c4-526f-49b8-bc36-dd54043d7cae tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2d9a790>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:25.736655 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2ee9d1c4-526f-49b8-bc36-dd54043d7cae tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.099254 Oct 23 02:18:25.737319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 405/808] 10.222.0.23 () {58 vars in 1149 bytes} [Sun Oct 23 02:18:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:25.752534 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-07d55e6d-5697-4c93-a7da-61fe66a06520 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da679c0d0>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:25.840696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-07d55e6d-5697-4c93-a7da-61fe66a06520 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092130 Oct 23 02:18:25.841645 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 404/809] 10.222.0.23 () {58 vars in 1134 bytes} [Sun Oct 23 02:18:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:25.855620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b7e3140c-1c08-4b1d-86eb-bfb7d16cbb74 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2deaa60>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:25.940321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b7e3140c-1c08-4b1d-86eb-bfb7d16cbb74 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088362 Oct 23 02:18:25.940946 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 406/810] 10.222.0.23 () {58 vars in 1167 bytes} [Sun Oct 23 02:18:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:25.955152 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1bb7be4c-0ebd-4656-8a20-6740a7ad7641 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2f725e0>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:26.187819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1bb7be4c-0ebd-4656-8a20-6740a7ad7641 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.236428 Oct 23 02:18:26.188395 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 405/811] 10.222.0.23 () {58 vars in 1170 bytes} [Sun Oct 23 02:18:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:26.202480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-359144d9-df01-444d-8b08-b0e68d886af8 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2deaaf0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:26.284282 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-359144d9-df01-444d-8b08-b0e68d886af8 tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086053 Oct 23 02:18:26.284848 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 407/812] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 23 02:18:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:26.298085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2688c708-c3d8-4a8e-ba5f-1a0301dc6b6d tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2f7ca60>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:26.381984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2688c708-c3d8-4a8e-ba5f-1a0301dc6b6d tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087531 Oct 23 02:18:26.382643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 406/813] 10.222.0.23 () {58 vars in 1188 bytes} [Sun Oct 23 02:18:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:26.396650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d09b7437-6d0f-47a4-bb13-b5ad3f851f2c tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] Calling method '.version_select at 0x7f9da2d9a280>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:26.477466 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d09b7437-6d0f-47a4-bb13-b5ad3f851f2c tempest-VolumesTestJSON-1512350877 tempest-VolumesTestJSON-1512350877-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084833 Oct 23 02:18:26.478029 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 408/814] 10.222.0.23 () {58 vars in 1155 bytes} [Sun Oct 23 02:18:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:26.502066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:26.502825 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:26.509578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:26.510174 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:26.510784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:26.511556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:26.512056 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:26.512488 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:26.655756 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:26.663403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-78722adb-b9b1-4394-90e5-e5a4104976dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.165179 Oct 23 02:18:26.663962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 407/815] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:26 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:27.688733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:27.689155 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:27.705923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:27.706415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:27.706875 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:27.707608 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:27.708244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:27.709044 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:27.844206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:27.852368 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-45b1280c-ddc8-4171-b262-719b3478940b tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.169573 Oct 23 02:18:27.853351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 409/816] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:27 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:28.876294 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:28.877338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:28.883668 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:28.884159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:28.884684 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:28.885305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:28.885788 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:28.886224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:29.021887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:29.030135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d7a46056-b163-40ed-9efe-7f060d9faee7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.157706 Oct 23 02:18:29.030760 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 408/817] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:28 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:30.053219 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:30.054396 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:30.061987 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:30.062696 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:30.063329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:30.064025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:30.064639 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:30.065221 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:30.201757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:30.210160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-243bc0da-80f3-4be6-ac4a-8f274e946395 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.160750 Oct 23 02:18:30.210758 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 410/818] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:30 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:31.234733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:31.235345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:31.241625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:31.242108 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:31.242573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:31.243289 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:31.244412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:31.244961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:31.389834 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:31.398027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-21d03e5a-8c3e-4a91-88d4-2aee7d831c05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.168257 Oct 23 02:18:31.398617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 409/819] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:31 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:31.568636 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-86aea3fa-69b0-441d-a0fd-b885cc460b70 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Action: 'create', calling method: .version_select at 0x7f9da2dbda60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-55828790", "metadata": {"Type": "work"}}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-86aea3fa-69b0-441d-a0fd-b885cc460b70 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Request method failure captured: Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 120 Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKR3OBfQzeD4WRnqqou6ENc5sIqlZPLHdP8XhKCTQrtyRbJwojZleWkSzQyDIUdPvcqxka3vrdSSUzRD82GVSFTEnCu9YaS__bK2EpbNoRcHar4PJ7BaHZBwleKRtOPyYMzH-zCAOqccpO39J7WNyr5Va4xPQQ97jVSYOiT8oAZzmrE Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:18:31.579767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: f44bce2010c249f2bd67108d86366258 Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-55828790", "metadata": {"Type": "work"}}} Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: Oct 23 02:18:31.581314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-55828790', 'metadata': {'Type': 'work'}}}} Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise error Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi '#$%' Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:31.582342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 02:18:31.584016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 02:18:31.585244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 23 02:18:31.585244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.585244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-86aea3fa-69b0-441d-a0fd-b885cc460b70 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:31.585244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-86aea3fa-69b0-441d-a0fd-b885cc460b70 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123494 Oct 23 02:18:31.585244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 411/820] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 23 02:18:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:18:31.590938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0ba0c29f-b115-4ff2-84bb-fda0f9b0d1d1 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Action: 'create', calling method: .version_select at 0x7f9da679c1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1981849912", "metadata": {"Type": "work"}}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0ba0c29f-b115-4ff2-84bb-fda0f9b0d1d1 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Request method failure captured: Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 120 Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKR3OBfQzeD4WRnqqou6ENc5sIqlZPLHdP8XhKCTQrtyRbJwojZleWkSzQyDIUdPvcqxka3vrdSSUzRD82GVSFTEnCu9YaS__bK2EpbNoRcHar4PJ7BaHZBwleKRtOPyYMzH-zCAOqccpO39J7WNyr5Va4xPQQ97jVSYOiT8oAZzmrE Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:18:31.595605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: f44bce2010c249f2bd67108d86366258 Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1981849912", "metadata": {"Type": "work"}}} Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: Oct 23 02:18:31.597194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1981849912', 'metadata': {'Type': 'work'}}}} Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise error Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi '0' Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:31.598159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 02:18:31.599751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 02:18:31.601230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 23 02:18:31.601230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.601230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0ba0c29f-b115-4ff2-84bb-fda0f9b0d1d1 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:31.601230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0ba0c29f-b115-4ff2-84bb-fda0f9b0d1d1 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009984 Oct 23 02:18:31.601230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 410/821] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 23 02:18:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 23 02:18:31.606756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-69081f99-68bf-4a9e-8283-03358fb9f2c4 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Action: 'create', calling method: .version_select at 0x7f9da2e62d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1425663172", "metadata": {"Type": "work"}}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-69081f99-68bf-4a9e-8283-03358fb9f2c4 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Request method failure captured: Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 119 Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKR3OBfQzeD4WRnqqou6ENc5sIqlZPLHdP8XhKCTQrtyRbJwojZleWkSzQyDIUdPvcqxka3vrdSSUzRD82GVSFTEnCu9YaS__bK2EpbNoRcHar4PJ7BaHZBwleKRtOPyYMzH-zCAOqccpO39J7WNyr5Va4xPQQ97jVSYOiT8oAZzmrE Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:18:31.611371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: f44bce2010c249f2bd67108d86366258 Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1425663172", "metadata": {"Type": "work"}}} Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: Oct 23 02:18:31.612812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1425663172', 'metadata': {'Type': 'work'}}}} Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise error Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi '' Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:31.613898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 23 02:18:31.615413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 23 02:18:31.616764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 23 02:18:31.616764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.616764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-69081f99-68bf-4a9e-8283-03358fb9f2c4 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:31.616764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-69081f99-68bf-4a9e-8283-03358fb9f2c4 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010258 Oct 23 02:18:31.616764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 412/822] 10.222.0.23 () {60 vars in 1156 bytes} [Sun Oct 23 02:18:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:18:31.622405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-df9ad7f6-5a3c-4b67-bee3-c39ce973488a tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Calling method '.version_select at 0x7f9da2f7c310>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:31.800091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-df9ad7f6-5a3c-4b67-bee3-c39ce973488a tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] HTTP exception thrown: Volume tempest-invalid-558327126 could not be found. Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-df9ad7f6-5a3c-4b67-bee3-c39ce973488a tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Request method failure captured: Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-558327126 HTTP/1.1 Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKR3OBfQzeD4WRnqqou6ENc5sIqlZPLHdP8XhKCTQrtyRbJwojZleWkSzQyDIUdPvcqxka3vrdSSUzRD82GVSFTEnCu9YaS__bK2EpbNoRcHar4PJ7BaHZBwleKRtOPyYMzH-zCAOqccpO39J7WNyr5Va4xPQQ97jVSYOiT8oAZzmrE Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:18:31.803433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: f44bce2010c249f2bd67108d86366258 Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Volume tempest-invalid-558327126 could not be found. Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'tempest-invalid-558327126'} Oct 23 02:18:31.804975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-558327126 could not be found. (HTTP 404) (Request-ID: req-982bed43-b126-4f2c-9268-12f8622bb53d) Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.805923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 02:18:31.807262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-558327126 could not be found. Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:31.809147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-558327126 could not be found. Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-558327126 could not be found. Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-df9ad7f6-5a3c-4b67-bee3-c39ce973488a tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Returning 404 to user: Volume tempest-invalid-558327126 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-df9ad7f6-5a3c-4b67-bee3-c39ce973488a tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-558327126" status: 404 len: 98 microversion: 2.1 time: 0.187070 Oct 23 02:18:31.810613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 411/823] 10.222.0.23 () {58 vars in 1215 bytes} [Sun Oct 23 02:18:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-558327126 => generated 98 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 23 02:18:31.815041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0d7c5aa2-ac36-40fe-8e36-07da59424423 tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003749 Oct 23 02:18:31.815540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 413/824] 10.222.0.23 () {58 vars in 1140 bytes} [Sun Oct 23 02:18:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 02:18:31.823533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0362d3d1-7d0f-47fe-a5c1-4e7f61788ddf tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003662 Oct 23 02:18:31.824698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 412/825] 10.222.0.23 () {58 vars in 1137 bytes} [Sun Oct 23 02:18:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 23 02:18:31.832977 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c5c3b9f6-efbd-4fd4-a11b-ae32f847656e tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Calling method '.version_select at 0x7f9da2e52ca0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:31.860849 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-c5c3b9f6-efbd-4fd4-a11b-ae32f847656e tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] HTTP exception thrown: Volume 627fa958-ac96-4821-911e-90838e1298c3 could not be found. Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c5c3b9f6-efbd-4fd4-a11b-ae32f847656e tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Request method failure captured: Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/os-volumes/627fa958-ac96-4821-911e-90838e1298c3 HTTP/1.1 Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKR3OBfQzeD4WRnqqou6ENc5sIqlZPLHdP8XhKCTQrtyRbJwojZleWkSzQyDIUdPvcqxka3vrdSSUzRD82GVSFTEnCu9YaS__bK2EpbNoRcHar4PJ7BaHZBwleKRtOPyYMzH-zCAOqccpO39J7WNyr5Va4xPQQ97jVSYOiT8oAZzmrE Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:18:31.862828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: f44bce2010c249f2bd67108d86366258 Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Volume 627fa958-ac96-4821-911e-90838e1298c3 could not be found. Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '627fa958-ac96-4821-911e-90838e1298c3'} Oct 23 02:18:31.864395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 627fa958-ac96-4821-911e-90838e1298c3 could not be found. (HTTP 404) (Request-ID: req-6d99122a-dea8-434f-9bab-939a452549c2) Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.865339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 23 02:18:31.866851 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 627fa958-ac96-4821-911e-90838e1298c3 could not be found. Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 23 02:18:31.868163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 627fa958-ac96-4821-911e-90838e1298c3 could not be found. Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 627fa958-ac96-4821-911e-90838e1298c3 could not be found. Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c5c3b9f6-efbd-4fd4-a11b-ae32f847656e tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Returning 404 to user: Volume 627fa958-ac96-4821-911e-90838e1298c3 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c5c3b9f6-efbd-4fd4-a11b-ae32f847656e tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/627fa958-ac96-4821-911e-90838e1298c3" status: 404 len: 109 microversion: 2.1 time: 0.034778 Oct 23 02:18:31.869472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 414/826] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:18:31 2022] DELETE /compute/v2.1/os-volumes/627fa958-ac96-4821-911e-90838e1298c3 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:31.874282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-930f5f2a-b050-42c9-98a4-fdeedaccf22b tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Calling method '.version_select at 0x7f9da679c1f0>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:31.902969 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-930f5f2a-b050-42c9-98a4-fdeedaccf22b tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] HTTP exception thrown: Volume bc587490-2049-4e3c-b3a3-a33482209f78 could not be found. Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-930f5f2a-b050-42c9-98a4-fdeedaccf22b tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Request method failure captured: Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/os-volumes/bc587490-2049-4e3c-b3a3-a33482209f78 HTTP/1.1 Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKR3OBfQzeD4WRnqqou6ENc5sIqlZPLHdP8XhKCTQrtyRbJwojZleWkSzQyDIUdPvcqxka3vrdSSUzRD82GVSFTEnCu9YaS__bK2EpbNoRcHar4PJ7BaHZBwleKRtOPyYMzH-zCAOqccpO39J7WNyr5Va4xPQQ97jVSYOiT8oAZzmrE Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:18:31.905518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/cf9e0b8c315d44369bcbb62d8ba14308"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: cf9e0b8c315d44369bcbb62d8ba14308 Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-VolumesNegativeTest-1503803567 Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: f44bce2010c249f2bd67108d86366258 Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-VolumesNegativeTest-1503803567-project Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Volume bc587490-2049-4e3c-b3a3-a33482209f78 could not be found. Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'bc587490-2049-4e3c-b3a3-a33482209f78'} Oct 23 02:18:31.906827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc587490-2049-4e3c-b3a3-a33482209f78 could not be found. (HTTP 404) (Request-ID: req-c6865406-ad5f-41d2-a4cd-8e92b4be61a7) Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.907593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 23 02:18:31.908733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc587490-2049-4e3c-b3a3-a33482209f78 could not be found. Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 23 02:18:31.909906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc587490-2049-4e3c-b3a3-a33482209f78 could not be found. Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc587490-2049-4e3c-b3a3-a33482209f78 could not be found. Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-930f5f2a-b050-42c9-98a4-fdeedaccf22b tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] Returning 404 to user: Volume bc587490-2049-4e3c-b3a3-a33482209f78 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-930f5f2a-b050-42c9-98a4-fdeedaccf22b tempest-VolumesNegativeTest-1503803567 tempest-VolumesNegativeTest-1503803567-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/bc587490-2049-4e3c-b3a3-a33482209f78" status: 404 len: 109 microversion: 2.1 time: 0.037225 Oct 23 02:18:31.911029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 413/827] 10.222.0.23 () {58 vars in 1245 bytes} [Sun Oct 23 02:18:31 2022] GET /compute/v2.1/os-volumes/bc587490-2049-4e3c-b3a3-a33482209f78 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:18:32.037774 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-26f100fc-df81-4c30-94af-dc733740f4bd req-582ae21b-563b-4eba-ab79-612ebca91eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e059be-46de-46ff-bbf2-55cb5c6b72ad", "name": "network-vif-plugged", "status": "completed", "tag": "d232d5a5-a6d8-44ab-a498-c1ef3fea2467"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:18:32.048906 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-26f100fc-df81-4c30-94af-dc733740f4bd req-582ae21b-563b-4eba-ab79-612ebca91eed service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:32.049567 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-26f100fc-df81-4c30-94af-dc733740f4bd req-582ae21b-563b-4eba-ab79-612ebca91eed service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:32.049995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-26f100fc-df81-4c30-94af-dc733740f4bd req-582ae21b-563b-4eba-ab79-612ebca91eed service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:32.061402 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-26f100fc-df81-4c30-94af-dc733740f4bd req-582ae21b-563b-4eba-ab79-612ebca91eed service nova] Creating event network-vif-plugged:d232d5a5-a6d8-44ab-a498-c1ef3fea2467 for instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad on hv-cinder-86149 Oct 23 02:18:32.066578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-26f100fc-df81-4c30-94af-dc733740f4bd req-582ae21b-563b-4eba-ab79-612ebca91eed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032974 Oct 23 02:18:32.067361 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 415/828] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:18:32.422229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:32.423433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:32.429626 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:32.430126 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:32.430603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:32.431312 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:32.431770 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:32.432272 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:32.566369 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:32.575621 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d0941f9a-46a7-4517-b1dd-8aca4f9112dc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.158253 Oct 23 02:18:32.576299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 414/829] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:32 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:33.600054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:33.600695 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:33.607240 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:33.607721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:33.608148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:33.608839 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:33.609288 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:33.609710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:33.613802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:18:33.755090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:33.763468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2f1c0f2d-924f-4a20-89c7-a7eac38ecc97 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1574 microversion: 2.1 time: 0.167469 Oct 23 02:18:33.764136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 416/830] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:33 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:18:34.786506 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:18:34.787124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:18:34.793520 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:34.794725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:34.795164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:34.796090 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:18:34.796723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:18:34.797014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:18:34.938971 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:18:34.947889 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4a72615d-8d35-421a-9c10-5fd7aa39aa84 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1561 microversion: 2.1 time: 0.165224 Oct 23 02:18:34.948702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 415/831] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:18:34 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:28.630081 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0abb6071-432d-452a-9e05-81e2a193c895 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Action: 'create', calling method: .version_select at 0x7f9da2dad700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-170373157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMbvJ5ZKHhBoVPAHuD1lmF7pE+4QBCK+3XGfSwl/D3zRgifRzAKiqILrD5qiySPEcf8Zji+1J9BSw8up++NC71mFINg2v3kX+XmcngtuYOfjPUOQoXsq9DlIH0QgjDwLA=="}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:28.635708 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=9 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:28.636798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=4 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:28.650080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-0abb6071-432d-452a-9e05-81e2a193c895 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Getting quotas for project 7d85fefc9f0b47f8bad45fb6dd0810f9. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:19:28.654687 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-0abb6071-432d-452a-9e05-81e2a193c895 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Getting quotas for user 7a3de8194ccd4eec9c19a6b250944457 and project 7d85fefc9f0b47f8bad45fb6dd0810f9. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:19:28.677875 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0abb6071-432d-452a-9e05-81e2a193c895 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051537 Oct 23 02:19:28.678410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 417/832] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:19:28 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:28.729180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1281159046", "imageRef": "cdcad2ea-d487-4c32-8cba-0153a777c711", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-170373157", "networks": [{"uuid": "df81527a-33c0-4994-b352-0d361111f171"}]}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:28.739327 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=18 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:28.739985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=40 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:28.786180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] validate_networks() for [('df81527a-33c0-4994-b352-0d361111f171', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:19:29.356590 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:19:29.357016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:19:29.357517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:19:29.357957 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:19:29.358378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:19:29.369223 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:29.369769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:29.370286 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:29.371061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:29.371567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:29.372052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:29.389343 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Getting quotas for project 7d85fefc9f0b47f8bad45fb6dd0810f9. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:19:29.393550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Getting quotas for user 7a3de8194ccd4eec9c19a6b250944457 and project 7d85fefc9f0b47f8bad45fb6dd0810f9. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:19:29.405469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:19:29.408072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cdcad2ea-d487-4c32-8cba-0153a777c711',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:19:29.454178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-eb16a712-3405-4d22-861f-5840c511139e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728810 Oct 23 02:19:29.454874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 416/833] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:19:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:19:29.467721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c96532ba-e268-4fa5-b266-1e4bc858696b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:29.468376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c96532ba-e268-4fa5-b266-1e4bc858696b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:29.529087 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c96532ba-e268-4fa5-b266-1e4bc858696b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:29.536980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c96532ba-e268-4fa5-b266-1e4bc858696b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1258 microversion: 2.1 time: 0.074918 Oct 23 02:19:29.537700 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 418/834] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:29 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:30.561248 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:30.561892 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:30.568437 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:30.568921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:30.569362 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:30.570048 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:30.570537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:30.570966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:30.632513 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:30.640630 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a1283504-eeb8-4d33-ae4d-0ec130c7bef6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1310 microversion: 2.1 time: 0.084096 Oct 23 02:19:30.641448 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 417/835] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:30 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:31.664540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:31.665879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:31.673607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:31.674111 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:31.674548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:31.675707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:31.675823 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:31.676248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:31.822598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:31.836025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-eb3ef2e0-72b4-44b3-977d-5c99079dfb3d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.175428 Oct 23 02:19:31.836601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 419/836] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:31 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:32.841480 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:32.842051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:32.848632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:32.849119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:32.849562 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:32.850261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:32.850754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:32.851185 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:32.861703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:32.862312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:32.870189 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:32.870945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:32.871728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:32.872706 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:32.873423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:32.874102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:32.875870 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f6575f53-6126-41eb-b1f4-df717c2893e1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/ips" status: 200 len: 151 microversion: 2.20 time: 0.038853 Oct 23 02:19:32.881040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 418/837] 10.222.0.23 () {60 vars in 1289 bytes} [Sun Oct 23 02:19:32 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 23 02:19:33.026566 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:33.039139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a18cf180-c953-4c03-acfa-c213000cc1d6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.181755 Oct 23 02:19:33.054791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 420/838] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:32 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:19:34.062614 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:34.063229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:34.069403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:34.069900 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:34.070335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:34.071072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:34.071528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:34.071955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:34.210525 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:34.220022 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-92a70a48-1f5d-4618-8541-3975777e28f3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.161474 Oct 23 02:19:34.220615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 419/839] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:34 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:34.800654 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:34.801200 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:34.809769 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:34.810368 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:34.811102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:34.811968 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:34.812480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:34.813181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:34.837283 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lazy-loading 'flavor' on Instance uuid 3fdb83af-0870-4f45-9164-d5539f2d667a {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:19:35.039453 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0e9ac30c-5672-46bc-9060-0847ec5b9d7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/action" status: 202 len: 0 microversion: 2.20 time: 0.242728 Oct 23 02:19:35.044477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 421/840] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 23 02:19:34 2022] POST /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:19:35.049530 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:35.050147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:35.056205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:35.056693 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:35.057132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:35.057826 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:35.058950 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:35.059446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:35.203598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:35.211791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:35.213537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:35.215352 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-dde741c3-b6e4-4163-9d2e-ba6875620a49 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.169749 Oct 23 02:19:35.215929 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 420/841] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:35 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:35.244969 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:35.246373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:35.252607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:35.253157 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:35.253533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:35.254232 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:35.254711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:35.255134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:35.393373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:35.401280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e544eca2-dfb6-48bd-adac-b9797659c438 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.160448 Oct 23 02:19:35.402393 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 422/842] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:35 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:36.241067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:36.241683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:36.248690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:36.249620 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:36.250205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:36.251317 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:36.252015 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:36.252582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:36.394895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:36.403372 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:36.404802 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:36.405947 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b48dba24-71c2-4639-976e-090510efb411 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.168801 Oct 23 02:19:36.406512 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 421/843] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:36 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:36.426070 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:36.426772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:36.433209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:36.433827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:36.434265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:36.434986 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:36.435439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:36.435945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:36.571280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:36.590673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-256b2beb-d233-494f-842a-05aa684e4709 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.168193 Oct 23 02:19:36.591304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 423/844] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:36 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:37.431347 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:37.432040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:37.439525 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:37.440009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:37.440442 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:37.441131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:37.441587 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:37.442002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:37.592685 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:37.601495 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:37.602977 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:37.604149 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c2cc7bfd-d814-4a3b-86be-f7151f07978b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.176687 Oct 23 02:19:37.604786 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 422/845] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:37 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:37.616991 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:37.617726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:37.624672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:37.625152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:37.625586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:37.626272 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:37.626792 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:37.627211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:37.760204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:37.769136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5643ad2a-2068-4d50-852d-b707e79f301a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.156013 Oct 23 02:19:37.769697 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 424/846] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:37 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:38.630536 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:38.631144 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:38.637479 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:38.637964 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:38.638396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:38.639938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:38.640351 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:38.640737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:38.778016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:38.787509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:38.788992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:38.790160 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f83a4fc5-ba59-4105-9117-20d86f3d6189 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.163563 Oct 23 02:19:38.790919 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 423/847] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:38 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:38.792762 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:38.793377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:38.805110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:38.805607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:38.806035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:38.807043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:38.807711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:38.808332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:38.948668 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:38.957287 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8e48677b-dfad-4f12-aad7-d43ea755cf7e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.168587 Oct 23 02:19:38.957852 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 425/848] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:38 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:39.815801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:39.816407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:39.818259 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:39.819051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=6 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:39.825320 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:39.825793 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:39.826225 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:39.827027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:39.827476 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:39.827898 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:39.961813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:39.970938 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:39.972371 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:39.973509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1f2b6f9c-1cbb-4dfc-b9f9-b50072165e4c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.161938 Oct 23 02:19:39.974084 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 424/849] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:39 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:39.979728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:39.980405 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:39.982410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=6 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:39.988701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:39.989179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:39.989607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:39.990287 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:39.990756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:39.991173 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:40.125110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:40.136569 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5aaaa0a5-7fd5-4db2-bcd3-6cccff34d0d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.160403 Oct 23 02:19:40.137166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 426/850] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:39 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:41.004752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:41.005693 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:41.014704 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:41.015503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:41.015916 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:41.016646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:41.017127 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:41.017545 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:41.152124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:41.162879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:41.163577 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:41.164371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:41.165489 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:41.166777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-410e9a71-61db-45a5-8200-b0bc2ce4ffc7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.170666 Oct 23 02:19:41.174260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 425/851] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:40 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:41.179634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:41.180429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:41.181632 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:41.182621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:41.183143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:41.184170 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:41.328324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:41.336937 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6da20e5a-32c9-4929-966c-5e62d5713a8c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.180258 Oct 23 02:19:41.347188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 427/852] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:41 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:42.195328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:42.195976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:42.203056 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:42.203676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:42.204116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:42.204820 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:42.205279 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:42.205709 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:42.340209 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:42.348282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:42.349704 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:42.350872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6fceae51-c2c6-42fe-a69a-0df91933fbf7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.159434 Oct 23 02:19:42.351794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 426/853] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:42 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:19:42.361440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:42.362679 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:42.368945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:42.369424 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:42.369858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:42.370573 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:42.371027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:42.371448 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:42.498798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:42.506339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-40555c6f-db72-4352-96f7-6f45b47f64d1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.149214 Oct 23 02:19:42.506925 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 428/854] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:42 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:43.376580 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:43.377190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:43.383628 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:43.384118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:43.384558 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:43.385245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:43.385705 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:43.386130 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:43.516057 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:43.524019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:43.525473 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:43.526672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e559d2e2-7185-4df2-801c-c4d6de26f4cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.154098 Oct 23 02:19:43.527223 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 427/855] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:43 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:43.528923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:43.529533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:43.536572 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:43.537063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:43.537487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:43.538168 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:43.538655 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:43.539077 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:43.665363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:43.673873 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-515177d0-fba2-4af0-a8d2-e64fffa383c1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.148673 Oct 23 02:19:43.674752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 429/856] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:43 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:19:44.552978 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:44.553507 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:44.560330 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:44.560818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:44.561257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:44.562645 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:44.563217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:44.563654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:44.711095 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:44.712603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:44.720008 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:44.720501 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:44.720938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:44.721653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:44.722134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:44.722630 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:44.905050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:44.914464 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:44.916078 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:44.917482 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ecda1e48-f9e2-44f7-a5d0-8672803a604c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.368587 Oct 23 02:19:44.918340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 428/857] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:44 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:45.001358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:45.009858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-09ff2983-d419-47d5-b09f-6103fa8f6318 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.307170 Oct 23 02:19:45.010487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 430/858] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:44 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:45.696076 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-b8e2d56a-6e1e-4d42-89ea-88930382fddd req-1a98882b-d800-446f-bd0d-2582d57eab35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df94ed8c-7abe-49c1-b835-b2a8fd4e2c43", "tag": "462339c3-99e2-4be4-ad61-d3a034c848c3"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:45.708758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b8e2d56a-6e1e-4d42-89ea-88930382fddd req-1a98882b-d800-446f-bd0d-2582d57eab35 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:45.709257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b8e2d56a-6e1e-4d42-89ea-88930382fddd req-1a98882b-d800-446f-bd0d-2582d57eab35 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:45.709687 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b8e2d56a-6e1e-4d42-89ea-88930382fddd req-1a98882b-d800-446f-bd0d-2582d57eab35 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:45.722050 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-b8e2d56a-6e1e-4d42-89ea-88930382fddd req-1a98882b-d800-446f-bd0d-2582d57eab35 service nova] Creating event network-changed:462339c3-99e2-4be4-ad61-d3a034c848c3 for instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 on hv-cinder-86149 Oct 23 02:19:45.727160 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-b8e2d56a-6e1e-4d42-89ea-88930382fddd req-1a98882b-d800-446f-bd0d-2582d57eab35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034765 Oct 23 02:19:45.727746 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 429/859] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:45.944141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:45.944670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:45.950876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:45.951349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:45.951777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:45.952948 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:45.953405 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:45.953829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:46.034955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:46.035652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:46.041851 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:46.042331 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:46.042789 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:46.043479 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:46.043928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:46.044347 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:46.224303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:46.232668 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:46.235178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:46.236506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-058b8541-15e4-46a3-8703-2340a23bbbb0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.296408 Oct 23 02:19:46.237063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 431/860] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:45 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:46.294934 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:46.303692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-958d6ef7-0cea-43d9-b62b-422204052e9c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.273531 Oct 23 02:19:46.304270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 430/861] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:46 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:19:47.263079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:47.263680 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:47.271053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:47.271525 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:47.271951 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:47.272624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:47.273068 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:47.273483 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:47.328035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:47.328835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:47.335123 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:47.335590 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:47.336030 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:47.336725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:47.337175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:47.337602 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:47.449949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:47.458415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:47.459808 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:47.460958 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ae61cc4b-98b3-4a0d-8847-ff6c3fe0d08b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.201835 Oct 23 02:19:47.461505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 432/862] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:47 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:47.494432 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:47.502762 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-78b5a556-064d-4abf-bcce-e1bf590b858b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.179276 Oct 23 02:19:47.503329 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 431/863] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:47 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:48.485735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:48.486338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:48.492657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:48.493130 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:48.493557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:48.494228 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:48.494702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:48.495120 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:48.513535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:48.526791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:48.527532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:48.534863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:48.535355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:48.535803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:48.536511 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:48.537083 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:48.537521 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:48.775720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:48.789102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:48.790702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:48.791939 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-de23f7fc-0a7a-40e4-b7c9-b8759d068c5c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.310175 Oct 23 02:19:48.792599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 433/864] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:48 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:48.799266 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:48.810690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b7788a25-0923-4074-b4cb-5283a3e79506 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.287652 Oct 23 02:19:48.813164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 432/865] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:48 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:19:49.817505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:49.818112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:49.824547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:49.825024 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:49.825459 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:49.826139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:49.826621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:49.827838 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:49.835707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:49.836431 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:49.843589 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:49.844115 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:49.844555 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:49.845254 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:49.845705 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:49.846126 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:50.021455 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:50.028236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:50.029377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:50.031166 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:50.032321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-989fccaa-d58a-4538-9485-3ccfd0df9172 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.218786 Oct 23 02:19:50.032874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 434/866] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:49 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:50.036119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fd821c12-0d80-4c21-9093-d194f736105a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.204306 Oct 23 02:19:50.036682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 433/867] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:49 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:19:51.057216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:51.057771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:51.059084 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:51.059704 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:51.064921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:51.065408 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:51.065839 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:51.066357 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:51.066547 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:51.066877 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:51.067018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:51.067325 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:51.067433 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:51.068024 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:51.068479 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:51.068907 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:51.072960 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:51.274815 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:51.277638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:51.282689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-12d3b2f3-377d-44f4-8cf3-a858510a7b29 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.227665 Oct 23 02:19:51.283271 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 434/868] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:51 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:51.286058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:51.287638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:51.288774 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d64ac20a-b034-418b-ac83-c5ac503d50ed tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.235540 Oct 23 02:19:51.289309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 435/869] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:51 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:52.306640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:52.307265 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:52.314730 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:52.314953 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:52.315399 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:52.315526 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:52.315730 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:52.316501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:52.317008 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:52.317616 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:52.328592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:52.329082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:52.329731 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:52.330694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:52.331254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:52.331655 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:52.517862 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:52.525658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2530ef2a-0b06-48f9-9f0d-b981b37720dc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.222927 Oct 23 02:19:52.534564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 435/870] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:52 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:52.534896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:52.536021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-a19a83b9-7162-45c1-ac2e-ea39f98f19de req-cca3484d-d1bb-446d-adeb-7cdf2ea50e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df94ed8c-7abe-49c1-b835-b2a8fd4e2c43", "name": "network-vif-plugged", "status": "completed", "tag": "462339c3-99e2-4be4-ad61-d3a034c848c3"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:52.541863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:52.543395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:52.544550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bf205db8-9a4a-4979-a8d0-4cdb3e1eec11 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.234082 Oct 23 02:19:52.545102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 436/871] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:52 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:19:52.545845 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a19a83b9-7162-45c1-ac2e-ea39f98f19de req-cca3484d-d1bb-446d-adeb-7cdf2ea50e16 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:52.546339 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a19a83b9-7162-45c1-ac2e-ea39f98f19de req-cca3484d-d1bb-446d-adeb-7cdf2ea50e16 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:52.546787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a19a83b9-7162-45c1-ac2e-ea39f98f19de req-cca3484d-d1bb-446d-adeb-7cdf2ea50e16 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:52.558049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-a19a83b9-7162-45c1-ac2e-ea39f98f19de req-cca3484d-d1bb-446d-adeb-7cdf2ea50e16 service nova] Creating event network-vif-plugged:462339c3-99e2-4be4-ad61-d3a034c848c3 for instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 on hv-cinder-86149 Oct 23 02:19:52.563632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-a19a83b9-7162-45c1-ac2e-ea39f98f19de req-cca3484d-d1bb-446d-adeb-7cdf2ea50e16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036113 Oct 23 02:19:52.564212 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 436/872] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:53.548888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:53.549498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:53.555881 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:53.556365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:53.556798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:53.557478 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:53.557929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:53.558351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:53.570618 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:53.571328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:53.578682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:53.579175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:53.579618 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:53.580312 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:53.580768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:53.581201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:53.754269 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:53.757388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:53.762031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-eac8f540-640a-4e91-bfc2-0cc8f8d3c01f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1358 microversion: 2.1 time: 0.217256 Oct 23 02:19:53.762618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 437/873] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:53 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:53.766313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:53.767795 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:53.768942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-aac327cd-dd17-4882-9722-330d1c4139ff tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.202603 Oct 23 02:19:53.769487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 437/874] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:53 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:19:54.785106 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:54.785708 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:54.792567 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:54.793110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:54.793582 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:54.794273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:54.794739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:54.795192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:54.795192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:54.795373 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:54.801780 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:54.802269 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:54.802752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:54.803452 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:54.803911 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:54.804340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.000743 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:55.004370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:55.008570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-171b006c-832d-4415-9cde-2e71d2bf91a5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1548 microversion: 2.1 time: 0.227282 Oct 23 02:19:55.009135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 438/875] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:54 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:55.012469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:55.014376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:55.015690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f504a30b-e888-452f-958f-0b76f9564470 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.225117 Oct 23 02:19:55.016245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 438/876] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:54 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:19:55.031768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:55.032364 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:55.038058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:55.038566 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:55.039002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.039670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:55.040112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:55.040527 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.168108 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:55.176197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5c422ebc-7346-4181-ad72-ed8814cc2197 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1548 microversion: 2.1 time: 0.148555 Oct 23 02:19:55.176753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 439/877] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:55 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:55.198526 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:55.203633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:55.204384 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Searching by: {'deleted': False, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9'} {{(pid=118878) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 23 02:19:55.213413 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:55.214257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:55.215096 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.216400 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:55.217241 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:55.217992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.313373 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.multi_cell_list [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118878) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 23 02:19:55.407868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0d6013f3-cdc1-4914-a06c-7996ed1a5040 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213043 Oct 23 02:19:55.408455 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 439/878] 10.222.0.23 () {58 vars in 1125 bytes} [Sun Oct 23 02:19:55 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:55.419843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:55.421601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:55.427424 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:55.427897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:55.428329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.429006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:55.429453 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:55.429870 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:55.556979 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:55.564827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b904c00c-3e0a-44a9-beb6-58e56f9f9195 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1548 microversion: 2.1 time: 0.148704 Oct 23 02:19:55.565334 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 440/879] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:19:55 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:19:56.041123 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:56.041746 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:56.048383 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:56.048867 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:56.049331 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:56.050019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:56.050500 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:56.050931 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:56.181928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:56.190403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:56.191982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:56.193126 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-65762bfb-f6d6-4f57-8775-c2e659cb42cf tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.156028 Oct 23 02:19:56.193683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 440/880] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:56 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:57.098124 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "977ea5df-e4b3-404b-bcc2-1ae3220e0978"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:57.100635 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:57.106759 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:57.107264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:57.108433 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:57.108942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:57.109397 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:57.109821 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:57.219805 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:57.220419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:57.226923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:57.227433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:57.227851 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:57.228550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:57.229003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:57.229428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:57.366014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:57.375598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:57.377030 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:57.378272 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bf1d0daa-3922-4b79-8d51-01c10a95c49c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.162883 Oct 23 02:19:57.379018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 441/881] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:57 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:19:57.390719 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-709e3141-daf5-419d-8d09-bcae8f1f183e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "POST /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296143 Oct 23 02:19:57.397263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 441/882] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:19:57 2022] POST /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:57.463969 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:57.465907 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:57.471644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:57.472215 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:57.472725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:57.473497 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:57.473958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:57.474380 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:57.497641 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8e6c80f4-301e-4989-b0e6-73d675b25626 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/ips" status: 200 len: 150 microversion: 2.1 time: 0.037336 Oct 23 02:19:57.498294 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 442/883] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:19:57 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:58.412053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:58.412742 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:58.418782 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:58.419263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:58.420427 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:58.421487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:58.421939 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:58.422359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:58.554789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:58.562870 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:58.564350 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:58.565496 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ee423004-649f-4b32-829a-e715ac75c83d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.158251 Oct 23 02:19:58.566054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 442/884] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:58 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:19:58.844053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "899c0c7b-f265-40c7-bc62-9c8e69dee3a0"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:19:58.846413 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:58.849920 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:58.853682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:58.854158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:58.854619 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:58.855311 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:58.855757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:58.856210 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:59.127040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-18836668-1cdc-41c7-a250-6e48d1cf2c00 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287832 Oct 23 02:19:59.127678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 443/885] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:19:58 2022] POST /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:19:59.590509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:19:59.591116 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:19:59.593609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:19:59.598706 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:59.599187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:59.599623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:59.600300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:19:59.600751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:19:59.601169 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:19:59.729913 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:59.738551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:59.740007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:19:59.741134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5a024d21-ae82-4742-a875-66972a35fef9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.154547 Oct 23 02:19:59.741695 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 443/886] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:19:59 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:00.769327 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:00.770023 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:00.776269 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:00.776745 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:00.777173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:00.777857 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:00.778305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:00.778761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:00.912303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:00.921001 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:00.922460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:00.923606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9a4cde79-787a-4b5f-9e50-42e1acb25789 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.160199 Oct 23 02:20:00.924167 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 444/887] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:00 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:01.948845 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:01.949448 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:01.955956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:01.956431 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:01.956862 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:01.957537 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:01.957983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:01.958401 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:02.085262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:02.094175 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:02.095639 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:02.096780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cd1829b6-a865-45eb-bc6d-b6924289b875 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.151826 Oct 23 02:20:02.097358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 444/888] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:01 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:03.122818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:03.123430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:03.130222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:03.130729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:03.131161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:03.131857 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:03.132305 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:03.132728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:03.261137 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:03.269585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:03.271229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:03.272364 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ea6b63f7-dd0a-45c4-a196-b2a7a99516fe tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.153482 Oct 23 02:20:03.272923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 445/889] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:03 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:04.299046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:04.299584 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:04.305875 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:04.306435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:04.306897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:04.307575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:04.308023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:04.308437 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:04.444178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:04.455204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:04.456503 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:04.457920 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1dc2778e-32cd-4ade-83eb-f1b56cea5f83 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.163558 Oct 23 02:20:04.471722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-f856932f-db46-444f-a8f1-2c9dc9ad1196 req-32ddbe16-21c4-40c4-8034-2df83805f222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb83af-0870-4f45-9164-d5539f2d667a", "name": "network-vif-plugged", "status": "completed", "tag": "d1b009dc-238c-4b94-abcc-f85c7f608d94"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:04.475380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 445/890] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:04 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:04.484904 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-f856932f-db46-444f-a8f1-2c9dc9ad1196 req-32ddbe16-21c4-40c4-8034-2df83805f222 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:04.485640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-f856932f-db46-444f-a8f1-2c9dc9ad1196 req-32ddbe16-21c4-40c4-8034-2df83805f222 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:04.486080 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-f856932f-db46-444f-a8f1-2c9dc9ad1196 req-32ddbe16-21c4-40c4-8034-2df83805f222 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:04.504570 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-f856932f-db46-444f-a8f1-2c9dc9ad1196 req-32ddbe16-21c4-40c4-8034-2df83805f222 service nova] Creating event network-vif-plugged:d1b009dc-238c-4b94-abcc-f85c7f608d94 for instance 3fdb83af-0870-4f45-9164-d5539f2d667a on hv-cinder-86149 Oct 23 02:20:04.509638 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-f856932f-db46-444f-a8f1-2c9dc9ad1196 req-32ddbe16-21c4-40c4-8034-2df83805f222 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042165 Oct 23 02:20:04.510238 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 446/891] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:05.483802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:05.484324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:05.490752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:05.491230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:05.491655 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:05.492329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:05.492772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:05.493186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:05.621472 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:05.630285 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:05.631732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:05.632869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0fb2108f-21fd-4965-870c-e6066ae94b7c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.153107 Oct 23 02:20:05.633416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 446/892] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:05 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:06.661848 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:06.662560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:06.664567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:06.670888 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:06.671370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:06.671803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:06.672487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:06.672936 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:06.673356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:06.806140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:06.814217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:06.815686 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:06.816826 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2b3ed37d-20a9-455a-9af3-ac935cad6bb1 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.159205 Oct 23 02:20:06.817385 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 447/893] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:06 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:06.940095 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:06.940579 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:06.946919 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:06.947407 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:06.947868 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:06.948557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:06.949012 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:06.949436 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:06.975553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-08330d5e-0a8c-4802-98fe-f02c8c356936 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/ips" status: 200 len: 146 microversion: 2.1 time: 0.039750 Oct 23 02:20:06.976105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 447/894] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:20:06 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:07.843132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:07.843681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:07.850127 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:07.850656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:07.851095 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:07.851786 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:07.852237 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:07.852663 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:07.980245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:07.989316 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:07.990780 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:07.991941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ee74f440-7645-49cb-ac34-f5953db2bf87 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.153351 Oct 23 02:20:07.992498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 448/895] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:07 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:09.020360 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:09.020909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:09.027256 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:09.027736 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:09.028170 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:09.028878 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:09.029326 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:09.029776 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:09.157607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:09.165674 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:09.167142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:09.168293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e9a72e2c-deea-45f6-b12b-ae75d89f7102 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.151952 Oct 23 02:20:09.168844 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 448/896] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:09 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:10.193936 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:10.194616 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:10.201035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:10.202256 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:10.202708 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:10.203366 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:10.203819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:10.204242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:10.335225 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:10.343428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:10.344875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:10.346029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ef331962-2f29-4940-9a51-f2d1a1a28f44 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.156069 Oct 23 02:20:10.346713 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 449/897] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:10 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:11.349435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:11.350045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:11.356580 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:11.357065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:11.357502 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:11.358214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:11.358713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:11.359139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:11.364058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:11.371543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:11.372154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:11.380509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:11.381236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:11.381866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:11.383063 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:11.383726 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:11.384345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:11.571692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:11.574043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:11.575260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:11.581559 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:11.583098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:11.584381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cb492451-ab45-4237-be39-20634892bf77 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1594 microversion: 2.1 time: 0.238678 Oct 23 02:20:11.584531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fab75da0-827a-47b9-8a48-20b2264ae4d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.216794 Oct 23 02:20:11.585340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 450/898] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:11 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:20:11.593961 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 449/899] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:11 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1594 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:12.523653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d7b4001-220c-43d2-a8bf-56b678248e27"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:12.526560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:12.533430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:12.534041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:12.534523 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:12.535215 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:12.535658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:12.536076 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:12.611666 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:12.612420 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:12.619212 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:12.619775 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:12.620278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:12.621066 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:12.621583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:12.622072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:12.833280 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4a53f823-3bf2-47c6-988e-f73606f05166 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313725 Oct 23 02:20:12.834389 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 451/900] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:20:12 2022] POST /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:13.069770 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:13.080271 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:13.082001 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:13.083235 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d6049eea-826a-40b7-9f65-25d595afaa78 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1745 microversion: 2.20 time: 0.477265 Oct 23 02:20:13.085015 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 450/901] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:12 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1745 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:13.678379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-8b393e1c-39a9-4419-828f-82c102deeb70 req-ddfa9060-fc12-48d5-8208-0172fe006710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df94ed8c-7abe-49c1-b835-b2a8fd4e2c43", "tag": "462339c3-99e2-4be4-ad61-d3a034c848c3"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:13.699002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8b393e1c-39a9-4419-828f-82c102deeb70 req-ddfa9060-fc12-48d5-8208-0172fe006710 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:13.699666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8b393e1c-39a9-4419-828f-82c102deeb70 req-ddfa9060-fc12-48d5-8208-0172fe006710 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:13.700268 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-8b393e1c-39a9-4419-828f-82c102deeb70 req-ddfa9060-fc12-48d5-8208-0172fe006710 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:13.715831 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-8b393e1c-39a9-4419-828f-82c102deeb70 req-ddfa9060-fc12-48d5-8208-0172fe006710 service nova] Creating event network-changed:462339c3-99e2-4be4-ad61-d3a034c848c3 for instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 on hv-cinder-86149 Oct 23 02:20:13.722100 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-8b393e1c-39a9-4419-828f-82c102deeb70 req-ddfa9060-fc12-48d5-8208-0172fe006710 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047594 Oct 23 02:20:13.723341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 452/902] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:14.110570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:14.111723 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:14.135303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:14.135713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:14.136152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:14.137711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:14.138173 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:14.138699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:14.524519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:14.539590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:14.542319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:14.543651 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4a78d154-d077-4807-a490-29a3c996e312 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.438027 Oct 23 02:20:14.570039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 451/903] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:14 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:15.409999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-946522446"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:15.410655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:15.417351 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:15.418071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:15.418539 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:15.419244 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:15.419739 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:15.420173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:15.560230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.network.security_group_api [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Adding security group 95f8d794-a1e7-4e95-84b8-39967694c309 to port 462339c3-99e2-4be4-ad61-d3a034c848c3 Oct 23 02:20:15.576944 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:15.578217 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:15.584984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:15.585745 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:15.586423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:15.587431 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:15.587964 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:15.588539 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:15.817931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:15.827712 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:15.829781 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:15.831843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-67bba465-4935-4f0d-bbf7-36b4908589f7 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.258964 Oct 23 02:20:15.843073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 452/904] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:15 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:15.988962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4be61ce0-dfc5-462f-8c0e-01d6151079de tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "POST /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/action" status: 202 len: 0 microversion: 2.1 time: 0.583555 Oct 23 02:20:15.989670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 453/905] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:20:15 2022] POST /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:20:16.001211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:16.001438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-1b030325-4e5c-4713-a4a5-ab63a45f54a9 req-175e4807-9110-40ff-9e03-cb5fc77f8ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df94ed8c-7abe-49c1-b835-b2a8fd4e2c43", "tag": "462339c3-99e2-4be4-ad61-d3a034c848c3"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:16.002357 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:16.008847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:16.009534 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:16.010698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:16.019618 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-1b030325-4e5c-4713-a4a5-ab63a45f54a9 req-175e4807-9110-40ff-9e03-cb5fc77f8ce1 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:16.021640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:16.022722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-1b030325-4e5c-4713-a4a5-ab63a45f54a9 req-175e4807-9110-40ff-9e03-cb5fc77f8ce1 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:16.023113 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:16.023402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-1b030325-4e5c-4713-a4a5-ab63a45f54a9 req-175e4807-9110-40ff-9e03-cb5fc77f8ce1 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:16.023928 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:16.040397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-1b030325-4e5c-4713-a4a5-ab63a45f54a9 req-175e4807-9110-40ff-9e03-cb5fc77f8ce1 service nova] Creating event network-changed:462339c3-99e2-4be4-ad61-d3a034c848c3 for instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 on hv-cinder-86149 Oct 23 02:20:16.046598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-1b030325-4e5c-4713-a4a5-ab63a45f54a9 req-175e4807-9110-40ff-9e03-cb5fc77f8ce1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049445 Oct 23 02:20:16.047756 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 454/906] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:16.366203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:16.378513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-beb0b53c-2de8-4930-b5ca-24007699cd1e tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1757 microversion: 2.1 time: 0.383837 Oct 23 02:20:16.379704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 453/907] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:15 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1757 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:16.865809 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:16.867468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:16.873350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:16.873916 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:16.874468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:16.875242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:16.875782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:16.876314 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:17.020953 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:17.030367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:17.031759 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:17.032935 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-20c6edf1-7861-4fed-86db-5dbde5b187a0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.176505 Oct 23 02:20:17.044351 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 455/908] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:16 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:18.058485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:18.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:18.066548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:18.067253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:18.068037 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:18.068911 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:18.069371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:18.069796 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:18.217109 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:18.226616 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:18.228075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:18.229232 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3c82a086-a650-4cbf-a629-0d0724440584 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.174889 Oct 23 02:20:18.229791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 454/909] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:18 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:20:18.349049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1439066139", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1022248569", "security_groups": [{"name": "tempest-secgroup-smoke-301932947"}], "block_device_mapping_v2": [{"uuid": "beb6b25d-c0c4-4e64-ab90-8c39fef94c29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c5e8bc1-ae7a-4263-95d0-aa588702beec"}]}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:18.474759 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] validate_networks() for [('6c5e8bc1-ae7a-4263-95d0-aa588702beec', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:20:18.891270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:20:18.891702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:20:18.892182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:20:18.892599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:20:18.893016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:20:18.906501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:18.907226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:18.907682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:18.908499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:18.909266 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:18.909916 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:18.939824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Getting quotas for project 10f27676e78f475fa9734f3d6f541da5. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:20:18.947633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Getting quotas for user d8cd3210dbea46d6912c93c6d28356ae and project 10f27676e78f475fa9734f3d6f541da5. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:20:19.014677 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:20:19.017252 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='beb6b25d-c0c4-4e64-ab90-8c39fef94c29',volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:20:19.175990 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9aa2a49a-c90b-4337-8231-53268c7467ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.830837 Oct 23 02:20:19.177226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 456/910] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:20:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 23 02:20:19.187750 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-547edd2d-9ac5-4a43-b5eb-442b682d1c08 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:19.188927 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-547edd2d-9ac5-4a43-b5eb-442b682d1c08 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:19.254803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:19.255865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:19.262593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:19.263683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:19.264301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:19.265199 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:19.265871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:19.266203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-547edd2d-9ac5-4a43-b5eb-442b682d1c08 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:19.266406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:19.275031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-547edd2d-9ac5-4a43-b5eb-442b682d1c08 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1095 microversion: 2.1 time: 0.091243 Oct 23 02:20:19.275607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 455/911] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:19 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:19.447699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:19.459463 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:19.461159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:19.462770 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ab6ecbea-0a83-4e00-aff9-b4c90cfab3fc tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.211814 Oct 23 02:20:19.482459 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 457/912] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:19 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:20:20.298097 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:20.299499 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:20.306589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:20.307193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:20.307985 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:20.308688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:20.309174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:20.309602 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:20.378061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:20.386135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-37456f42-56a2-4c56-9261-924624552628 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1193 microversion: 2.1 time: 0.092380 Oct 23 02:20:20.386734 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 456/913] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:20 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:20.490828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:20.491516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:20.499031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:20.499546 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:20.499977 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:20.500666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:20.501113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:20.501535 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:20.674553 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:20.688399 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:20.690042 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:20.691234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9ee7c237-e9dd-4e50-8618-d2df073b11d0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.205595 Oct 23 02:20:20.692445 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 458/914] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:20 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:21.410077 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:21.411325 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:21.417827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:21.418368 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:21.418831 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:21.419542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:21.419995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:21.421005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:21.491585 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:21.500388 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3609caee-4798-40a2-b763-2e715016cd66 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1193 microversion: 2.1 time: 0.094536 Oct 23 02:20:21.514821 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 457/915] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:21 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:21.716150 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:21.716814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:21.724113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:21.724599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:21.725033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:21.725915 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:21.726369 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:21.726818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:21.939806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:21.960171 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:21.961680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:21.962992 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ca9bc9b8-68fa-45ad-846c-abe036967963 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.250725 Oct 23 02:20:21.963567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 459/916] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:21 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:22.524148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:22.525444 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:22.533903 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:22.534693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:22.535138 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:22.535846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:22.536302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:22.536730 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:22.657845 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:22.671501 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-6da1eb53-4927-454f-a4e7-656e7b31b8ce tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1211 microversion: 2.1 time: 0.151116 Oct 23 02:20:22.672403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 458/917] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:22 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1211 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:22.908709 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "899c0c7b-f265-40c7-bc62-9c8e69dee3a0"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:22.912649 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:22.919839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:22.920817 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:22.921492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:22.922429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:22.923174 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:22.924063 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:22.990433 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:22.991826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:23.004640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.005387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.008327 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.009491 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.010188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.012517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.027871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Invalid volume: volume 899c0c7b-f265-40c7-bc62-9c8e69dee3a0 is already attached to instances: feb9b7c7-7380-423a-b0c5-43e7d775e9e7 Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: POST /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments HTTP/1.1 Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 74 Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:20:23.031417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {"volumeAttachment": {"volumeId": "899c0c7b-f265-40c7-bc62-9c8e69dee3a0"}} Oct 23 02:20:23.032958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Invalid volume: volume 899c0c7b-f265-40c7-bc62-9c8e69dee3a0 is already attached to instances: feb9b7c7-7380-423a-b0c5-43e7d775e9e7 Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'server_id': 'feb9b7c7-7380-423a-b0c5-43e7d775e9e7', 'body': {'volumeAttachment': {'volumeId': '899c0c7b-f265-40c7-bc62-9c8e69dee3a0'}}} Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 899c0c7b-f265-40c7-bc62-9c8e69dee3a0 is already attached to instances: feb9b7c7-7380-423a-b0c5-43e7d775e9e7 Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:23.033737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 899c0c7b-f265-40c7-bc62-9c8e69dee3a0 is already attached to instances: feb9b7c7-7380-423a-b0c5-43e7d775e9e7 Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:23.035350 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:23.037981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:23.037981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:20:23.037981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:20:23.037981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 899c0c7b-f265-40c7-bc62-9c8e69dee3a0 is already attached to instances: feb9b7c7-7380-423a-b0c5-43e7d775e9e7 Oct 23 02:20:23.037981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:23.037981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 400 to user: Invalid volume: volume 899c0c7b-f265-40c7-bc62-9c8e69dee3a0 is already attached to instances: feb9b7c7-7380-423a-b0c5-43e7d775e9e7 {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:20:23.037981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-95a992ba-6696-419e-a68c-e5576b613695 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129812 Oct 23 02:20:23.042238 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 460/918] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:20:22 2022] POST /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:20:23.111605 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:23.112583 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:23.120065 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.120975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.121660 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.122714 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.125067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.125777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.237471 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lazy-loading 'services' on Instance uuid feb9b7c7-7380-423a-b0c5-43e7d775e9e7 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:20:23.302982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:23.311826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:23.314684 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:23.316069 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b6566d9e-1a5c-467a-acc9-7918c011773d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.330052 Oct 23 02:20:23.317540 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 459/919] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:22 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:23.360584 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e111c94a-8247-4eb8-9928-621f6269f42f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments/899c0c7b-f265-40c7-bc62-9c8e69dee3a0" status: 202 len: 0 microversion: 2.1 time: 0.254563 Oct 23 02:20:23.361246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 461/920] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:20:23 2022] DELETE /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments/899c0c7b-f265-40c7-bc62-9c8e69dee3a0 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:20:23.370038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:23.372746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:23.380441 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.381310 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.382098 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.383064 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.383732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.384382 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.417380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4720e1bd-3220-4c38-99d6-31ee7a6bb48e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051253 Oct 23 02:20:23.418042 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 460/921] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:23 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:23.697124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:23.697840 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:23.714236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.714771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.715219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:23.715927 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:23.725933 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:23.728161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:24.249626 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:24.266205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-330ed45b-5688-4c02-b2e1-4f5197e93553 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1278 microversion: 2.1 time: 0.567957 Oct 23 02:20:24.267271 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 462/922] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:23 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1278 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:24.345365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:24.347125 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:24.354647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:24.355398 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:24.356018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:24.357889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:24.358746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:24.360114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:24.431406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:24.434819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:24.460358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:24.460871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:24.461322 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:24.462049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:24.462542 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:24.462980 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:24.495532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d8aec6fc-5627-47fe-bc61-69fa929e062c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068219 Oct 23 02:20:24.501262 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 463/923] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:24 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:24.923869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:24.933651 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:24.938182 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:24.939377 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-33ca182f-ab5f-4afe-8528-9a28774cab2f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.600209 Oct 23 02:20:24.943431 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 461/924] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:24 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:25.017932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:25.018330 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:25.026312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-b0e897e3-91d6-4967-9b49-84fd8531e13b req-4940d33b-de78-4bb1-8d36-5eab40c35f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e059be-46de-46ff-bbf2-55cb5c6b72ad", "tag": "d232d5a5-a6d8-44ab-a498-c1ef3fea2467"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:25.052101 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.052587 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.053035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.053734 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.054180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.058323 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-b0e897e3-91d6-4967-9b49-84fd8531e13b req-4940d33b-de78-4bb1-8d36-5eab40c35f70 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.066061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.069440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-b0e897e3-91d6-4967-9b49-84fd8531e13b req-4940d33b-de78-4bb1-8d36-5eab40c35f70 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.070088 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-b0e897e3-91d6-4967-9b49-84fd8531e13b req-4940d33b-de78-4bb1-8d36-5eab40c35f70 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.101418 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-b0e897e3-91d6-4967-9b49-84fd8531e13b req-4940d33b-de78-4bb1-8d36-5eab40c35f70 service nova] Creating event network-changed:d232d5a5-a6d8-44ab-a498-c1ef3fea2467 for instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad on hv-cinder-86149 Oct 23 02:20:25.118886 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-b0e897e3-91d6-4967-9b49-84fd8531e13b req-4940d33b-de78-4bb1-8d36-5eab40c35f70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096094 Oct 23 02:20:25.125732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 462/925] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:25.132308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-6b4b7eb4-3759-414b-a5a5-5313e8e0e86e req-ce9dbb25-471a-4056-a823-d6eb67a224d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa5faf5-5722-40fd-b4aa-c8a419e8c73d", "tag": "6ebd6dec-ed9e-49f3-9f6a-d935781e2f04"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:25.141646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:20:25.157370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-6b4b7eb4-3759-414b-a5a5-5313e8e0e86e req-ce9dbb25-471a-4056-a823-d6eb67a224d9 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.158200 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-6b4b7eb4-3759-414b-a5a5-5313e8e0e86e req-ce9dbb25-471a-4056-a823-d6eb67a224d9 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.158885 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-6b4b7eb4-3759-414b-a5a5-5313e8e0e86e req-ce9dbb25-471a-4056-a823-d6eb67a224d9 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.198033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-6b4b7eb4-3759-414b-a5a5-5313e8e0e86e req-ce9dbb25-471a-4056-a823-d6eb67a224d9 service nova] Creating event network-changed:6ebd6dec-ed9e-49f3-9f6a-d935781e2f04 for instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d on hv-cinder-86149 Oct 23 02:20:25.205680 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-6b4b7eb4-3759-414b-a5a5-5313e8e0e86e req-ce9dbb25-471a-4056-a823-d6eb67a224d9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078244 Oct 23 02:20:25.214681 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 463/926] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:25.293705 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ea0b30fd-66f5-4f05-8530-aedbd85b8a9d tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "DELETE /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 204 len: 0 microversion: 2.1 time: 0.280148 Oct 23 02:20:25.294778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:25.295786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:25.298400 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 464/927] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:20:25 2022] DELETE /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:20:25.311710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.312234 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.312608 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.313170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:25.313297 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.313735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.314097 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:25.314227 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.320521 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.321067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.321571 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.322335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.322875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.323401 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.553950 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:25.563357 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b51136cd-7ab6-4ea5-9889-f6449ff958bc tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.260027 Oct 23 02:20:25.564580 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 465/928] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:25 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:25.569865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:25.572409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:25.581221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.582091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.582884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.583840 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.584503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.585136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.610865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:25.625813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c26e867a-b308-43c4-beab-a703b52b7595 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059731 Oct 23 02:20:25.631645 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 466/929] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:25 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:25.638035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:25.650360 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e09ab24e-1d56-46be-9361-50555ff52b8d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1278 microversion: 2.1 time: 0.362437 Oct 23 02:20:25.651372 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 464/930] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:25 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1278 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:25.973027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:25.973859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:25.982029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.983509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.984089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:25.984908 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:25.985472 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:25.986003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:26.142637 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:26.153272 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:26.155903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:26.157263 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-803c864b-a1de-4905-910e-910c033d4835 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.190966 Oct 23 02:20:26.158323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 467/931] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:25 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:20:26.592768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:26.593616 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:26.600309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:26.601027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:26.601639 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:26.602581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:26.603213 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:26.603912 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:26.639048 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:26.642379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:26.657332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:26.657986 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:26.658596 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:26.659436 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:26.660161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:26.660819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:26.708961 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e16470a4-d2b8-4351-adf0-fbd851c08efe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074041 Oct 23 02:20:26.709974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 468/932] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:26 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:26.714633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:26.715239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:26.722022 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:26.722532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:26.722969 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:26.723790 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:26.724089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:26.724503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:26.947763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:26.958577 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2bf30721-a2b5-42ae-bd49-88ee9cd8b789 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.370951 Oct 23 02:20:26.959513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 465/933] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:26 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:27.044031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:27.052004 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bfa28a96-9f76-421b-84de-dbc67079bd09 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1278 microversion: 2.1 time: 0.340948 Oct 23 02:20:27.052574 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 469/934] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:26 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1278 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:27.183765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:27.184294 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:27.190637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:27.191119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:27.191565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:27.192226 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:27.192673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:27.193091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:27.368126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:27.377486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:27.378945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:27.380093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b294461a-22c4-4f8d-aac6-15142fd733f5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1740 microversion: 2.20 time: 0.200266 Oct 23 02:20:27.380640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 466/935] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:27 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:27.722182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:27.724300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:27.730689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:27.731163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:27.731598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:27.732896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:27.733345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:27.733771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:27.763910 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f9de7614-67d1-40bc-b2b5-a8939d410cca tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Oct 23 02:20:27.764469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 470/936] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:27 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:27.983611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:27.984152 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:27.990276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:27.990789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:27.991317 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:27.992162 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:27.992713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:27.993129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.074999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:28.075777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:28.082096 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.082702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.083225 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.084001 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.084557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.085166 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.157934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:28.165799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-263ff21c-c09c-4920-a025-3476c962683f tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1567 microversion: 2.1 time: 0.186622 Oct 23 02:20:28.166379 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 467/937] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:27 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:28.224988 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:28.234966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1fe09a02-df03-4a53-8f6f-516146dae068 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1278 microversion: 2.1 time: 0.163384 Oct 23 02:20:28.235552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 471/938] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:28 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:28.407276 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:28.407889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:28.413799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.414282 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.414749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.415434 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.415899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.416320 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.420404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:28.546284 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:28.554362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:28.555826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:28.556974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-316af008-9fbd-443b-a401-bcae5eb824ce tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1722 microversion: 2.20 time: 0.154356 Oct 23 02:20:28.557537 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 468/939] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:28 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:28.776342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:28.778513 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:28.785314 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.785792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.786224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.786956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:28.787403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:28.787821 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:28.817687 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-41f4e5b8-9650-4373-8d92-1b81849d2edd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Oct 23 02:20:28.818247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 472/940] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:28 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:29.190894 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:29.191509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:29.197812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:29.198297 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:29.198771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:29.199739 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:29.200205 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:29.200637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:29.262045 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:29.263634 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:29.269249 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:29.270509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=6 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:29.271600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:29.272360 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:29.280869 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:29.281860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:29.282828 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:29.284594 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:29.285484 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:29.286567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:29.691492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:29.699579 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f300cfd4-95c7-46b2-b03c-bcc2e74694e4 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1449 microversion: 2.1 time: 0.512496 Oct 23 02:20:29.713131 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 469/941] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:29 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1449 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:29.721434 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:29.722070 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:29.727526 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=56 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:29.729268 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:29.729797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:29.730204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:29.731165 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:29.731816 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:29.732945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:29.781860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:29.793716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-edb3dbc9-6e4e-45dd-adbd-e71c8fbdaeb1 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1278 microversion: 2.1 time: 0.539247 Oct 23 02:20:29.795049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 473/942] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:29 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1278 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:29.830718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:29.833285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:29.840163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:29.840875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:29.842316 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:29.843435 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:29.844055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:29.844740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:29.904975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3059d298-d4ca-446d-b9e0-2eeeb3127771 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078349 Oct 23 02:20:29.905927 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 474/943] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:29 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:30.093079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:30.101438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:30.102990 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:30.104372 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5b0f240d-c6ce-4f4b-ac14-184a4ee73070 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1722 microversion: 2.20 time: 0.390203 Oct 23 02:20:30.105031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 470/944] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:29 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:30.279638 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-05624a3e-cad7-4166-aad7-4f2b30a55a21 req-a2b8bb83-8302-4040-8703-177190905015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e059be-46de-46ff-bbf2-55cb5c6b72ad", "name": "network-vif-deleted", "tag": "d232d5a5-a6d8-44ab-a498-c1ef3fea2467"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:30.292277 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:30.295336 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:30.296009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-05624a3e-cad7-4166-aad7-4f2b30a55a21 req-a2b8bb83-8302-4040-8703-177190905015 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.296504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-05624a3e-cad7-4166-aad7-4f2b30a55a21 req-a2b8bb83-8302-4040-8703-177190905015 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.296994 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-05624a3e-cad7-4166-aad7-4f2b30a55a21 req-a2b8bb83-8302-4040-8703-177190905015 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.303150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.303923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.304574 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.305512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.306196 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.306871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.331124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-05624a3e-cad7-4166-aad7-4f2b30a55a21 req-a2b8bb83-8302-4040-8703-177190905015 service nova] Creating event network-vif-deleted:d232d5a5-a6d8-44ab-a498-c1ef3fea2467 for instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad on hv-cinder-86149 Oct 23 02:20:30.337912 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-05624a3e-cad7-4166-aad7-4f2b30a55a21 req-a2b8bb83-8302-4040-8703-177190905015 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062708 Oct 23 02:20:30.338549 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 475/945] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:30.346192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3b7369a7-59c3-48c2-a956-ad9fe0bc7b06 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057769 Oct 23 02:20:30.346883 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 471/946] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:30 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:30.359407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:30.359999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:30.366524 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.367025 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.367457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.368246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.368619 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.369098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.423619 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-04cdfba4-2c96-4dc7-bd18-ce2914f28bea tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/6d7b4001-220c-43d2-a8bf-56b678248e27" status: 200 len: 194 microversion: 2.1 time: 0.069331 Oct 23 02:20:30.424926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 476/947] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Oct 23 02:20:30 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/6d7b4001-220c-43d2-a8bf-56b678248e27 => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:30.573067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-345bc76c-5251-42ea-ac3f-833b1af3066d req-b62c46b1-128b-4ec3-a0e4-e21538ace7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb83af-0870-4f45-9164-d5539f2d667a", "name": "network-vif-unplugged", "status": "completed", "tag": "d1b009dc-238c-4b94-abcc-f85c7f608d94"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:30.591810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-345bc76c-5251-42ea-ac3f-833b1af3066d req-b62c46b1-128b-4ec3-a0e4-e21538ace7a0 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.601948 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-345bc76c-5251-42ea-ac3f-833b1af3066d req-b62c46b1-128b-4ec3-a0e4-e21538ace7a0 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.602629 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-345bc76c-5251-42ea-ac3f-833b1af3066d req-b62c46b1-128b-4ec3-a0e4-e21538ace7a0 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.618018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-345bc76c-5251-42ea-ac3f-833b1af3066d req-b62c46b1-128b-4ec3-a0e4-e21538ace7a0 service nova] Creating event network-vif-unplugged:d1b009dc-238c-4b94-abcc-f85c7f608d94 for instance 3fdb83af-0870-4f45-9164-d5539f2d667a on hv-cinder-86149 Oct 23 02:20:30.630755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-345bc76c-5251-42ea-ac3f-833b1af3066d req-b62c46b1-128b-4ec3-a0e4-e21538ace7a0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069756 Oct 23 02:20:30.633778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 472/948] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:30.728089 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:30.728962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:30.743391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.744191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.744843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.745895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.746785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.747592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.818861 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:30.820381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:30.828548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.829618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.830435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.832057 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.832741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.833435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.836548 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:30.852352 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-83fa6563-08fd-49f3-bd74-e299e18e1db7 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1220 microversion: 2.1 time: 0.128043 Oct 23 02:20:30.853263 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 477/949] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:30 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:30.917537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:30.919955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:30.926474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.927467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.927983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.928662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:30.929124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:30.929557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:30.966824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-97681c6e-3701-4d01-a89a-6def4c0dfe6d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053340 Oct 23 02:20:30.967719 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 478/950] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:30 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:31.005003 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:31.013757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5397b37e-f6a2-45bd-b4dc-35a7aa09f769 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1278 microversion: 2.1 time: 0.199995 Oct 23 02:20:31.014490 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 473/951] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:30 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:31.130984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:31.131612 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:31.138415 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.138926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.139366 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.140061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.140520 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.140952 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.281718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:31.289855 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:31.291371 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:31.292529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-19f6ba6a-a907-43e9-a450-d62859afaa7b tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1722 microversion: 2.20 time: 0.165441 Oct 23 02:20:31.293090 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 479/952] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:31 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:31.875616 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:31.876231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:31.882648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.883130 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.883568 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.884248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.884699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.885122 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.915061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.915537 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.916174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.916429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lazy-loading 'fault' on Instance uuid 63e059be-46de-46ff-bbf2-55cb5c6b72ad {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:20:31.958133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:31.966497 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b53e63e7-68e5-42fb-9554-a04b751bdd4e tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1225 microversion: 2.1 time: 0.094180 Oct 23 02:20:31.967054 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 474/953] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:31 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:31.979631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:31.982715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:31.989187 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.989673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.990119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:31.990842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:31.991303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:31.991733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:32.021633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6abdeb9e-ee14-4c63-aacf-68c64546a849 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Oct 23 02:20:32.022189 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 480/954] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:31 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:32.036707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:32.037321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:32.043188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:32.043673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:32.044120 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:32.044802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:32.045261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:32.045689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:32.177471 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:32.185620 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0a91f978-d95e-4781-b6df-1299431eb6f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.152762 Oct 23 02:20:32.186184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 475/955] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:32 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:32.318933 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:32.319542 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:32.326528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:32.327009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:32.327445 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:32.328128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:32.328578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:32.328999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:32.463158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:32.471955 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:32.473382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:32.474684 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-96238c75-1be9-42be-b4fa-b5dea336fb52 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1722 microversion: 2.20 time: 0.159558 Oct 23 02:20:32.475247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 481/956] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:32 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:32.988902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:32.989504 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:32.995925 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:32.996410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:32.996835 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:32.998090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:32.998564 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:32.998991 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.029787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75472e38-1f0f-4790-bb9c-e842bfc0d705"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:33.030347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.030347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.030716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.031160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lazy-loading 'fault' on Instance uuid 63e059be-46de-46ff-bbf2-55cb5c6b72ad {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:20:33.032156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:33.038670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.039168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.039610 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.040308 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.040765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.041190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.072709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:33.081225 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7bf5d16e-0433-4025-a8e4-97a6d6f804e3 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1225 microversion: 2.1 time: 0.096013 Oct 23 02:20:33.081800 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 476/957] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:32 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:33.086424 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:33.088672 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:33.094471 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.094978 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.095421 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.096119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.096577 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.097017 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.128175 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b8a7e5f1-9621-4233-9963-014bbbc7cdfe tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Oct 23 02:20:33.128737 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 477/958] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:33 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:33.208657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:33.209264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:33.215019 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.215506 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.216716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.217135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.217591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.218015 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.345663 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:33.353462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-97645a65-93bb-4cfd-a4d9-b05b7f036411 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.148386 Oct 23 02:20:33.354020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 478/959] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:33 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:33.499699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:33.500303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:33.506190 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.506705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.507139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.507827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:33.508277 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:33.508703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:33.640151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:33.648100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:33.649525 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:33.650693 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-de49eb44-734e-44be-9e4d-a15e9d8a5b65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1722 microversion: 2.20 time: 0.154914 Oct 23 02:20:33.651245 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 479/960] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:33 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:20:34.104007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:34.104750 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:34.111268 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.111747 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.112175 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.112854 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.113298 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.113776 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.147761 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.148264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.148640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.149080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lazy-loading 'fault' on Instance uuid 63e059be-46de-46ff-bbf2-55cb5c6b72ad {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:20:34.195302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102283eee43142f29645e3faa6501891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7bb15a157314fb095d2333f64ab0c83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:34.203896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-60b807c8-3b2b-4dd0-adb6-b2bff1c6ce13 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 200 len: 1225 microversion: 2.1 time: 0.104155 Oct 23 02:20:34.205294 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 480/961] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:34 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:34.210356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:34.212823 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:34.229628 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.230581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.230581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.231767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.232219 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.232647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.268431 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f1cd822a-6ac2-4f94-a5a6-7b11505dba80 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062923 Oct 23 02:20:34.269013 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 481/962] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:34 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:34.319919 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:34.349060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f109c31d-c849-4e71-acdf-10032b2bc463 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "POST /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.323411 Oct 23 02:20:34.355725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 482/963] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:20:33 2022] POST /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments => generated 194 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:34.383862 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:34.384544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:34.392222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.392956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.393604 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.394496 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.395215 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.395883 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.612685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:34.620386 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d95205c9-3108-4752-9351-04b4c6780a7c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.240919 Oct 23 02:20:34.620941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 482/964] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:34 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:34.677322 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:34.677924 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:34.684649 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.685337 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.685568 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.686263 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.686740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.687166 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.877373 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:34.897915 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:34.904260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:34.905801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-773b752c-9717-416f-b701-1419b1d4dc26 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1725 microversion: 2.20 time: 0.233310 Oct 23 02:20:34.922503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 483/965] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:34 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:34.931949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "756777ac-c98e-4a41-85f2-a38cf9f9e956"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:34.935060 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:34.946746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.954529 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.956626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:34.958231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:34.958980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:34.959575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.156804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:35.228847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:35.229682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] [instance: 63e059be-46de-46ff-bbf2-55cb5c6b72ad] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:35.236603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.237150 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.237785 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.238662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.239113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.239540 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.254872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] HTTP exception thrown: Instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad could not be found. Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Request method failure captured: Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad HTTP/1.1 Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKN0XtBZm45nSVy_h4-7ODF3Kc2e4SU06g1xN-xmD5CSnDYX13UEF64qqgLvMR0hn4avs26-qn9NPEA4NKz2T5aL_OMmF1ULGpW5n3W9t8zXvW3oy6fAtiwwS4JwXC53Z7PZ3Jk-DPpOItLTsvp8pnSdMWzkl7HEm9aGTJQKgV8x0lY Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: d7bb15a157314fb095d2333f64ab0c83 Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-TestShelveInstance-1206284386 Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:20:35.256664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7bb15a157314fb095d2333f64ab0c83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d7bb15a157314fb095d2333f64ab0c83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d7bb15a157314fb095d2333f64ab0c83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d7bb15a157314fb095d2333f64ab0c83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-TestShelveInstance-1206284386 Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: d7bb15a157314fb095d2333f64ab0c83 Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-TestShelveInstance-1206284386 Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-TestShelveInstance-1206284386-project Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 102283eee43142f29645e3faa6501891 Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-TestShelveInstance-1206284386-project Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad could not be found. Oct 23 02:20:35.258355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '63e059be-46de-46ff-bbf2-55cb5c6b72ad'} Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad could not be found. Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:20:35.259423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad could not be found. Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad could not be found. Oct 23 02:20:35.261791 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:20:35.263564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Returning 404 to user: Instance 63e059be-46de-46ff-bbf2-55cb5c6b72ad could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:20:35.263653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-53603204-0da0-4fc4-b9ba-99a9228811e2 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329194 Oct 23 02:20:35.263806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7bf89cfc-6099-4b8e-a5eb-c64785f15b05 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad" status: 404 len: 111 microversion: 2.1 time: 0.033550 Oct 23 02:20:35.263806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 484/966] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:35 2022] GET /compute/v2.1/servers/63e059be-46de-46ff-bbf2-55cb5c6b72ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:20:35.263966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 483/967] 10.222.0.23 () {62 vars in 1364 bytes} [Sun Oct 23 02:20:34 2022] POST /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 23 02:20:35.283073 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:35.285666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:35.291707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.292306 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.292849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.293856 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.294414 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.294979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.325446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b44a60ef-1f5b-4db1-aef1-6b843deaab35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047281 Oct 23 02:20:35.326501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 485/968] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:35 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:20:35.416120 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:35.416863 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:35.423642 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.424429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.425748 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.427182 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.428039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.428749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.474340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Going to try to terminate instance {{(pid=118877) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:20:35.489689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-88f823d0-290b-4cc1-953c-f8362d2b6666 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] Calling method '.version_select at 0x7f9da310ac10>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:35.517270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-88f823d0-290b-4cc1-953c-f8362d2b6666 tempest-TestShelveInstance-1206284386 tempest-TestShelveInstance-1206284386-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1437934688" status: 202 len: 0 microversion: 2.1 time: 0.031592 Oct 23 02:20:35.518405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 486/969] 10.222.0.23 () {58 vars in 1254 bytes} [Sun Oct 23 02:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1437934688 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:20:35.523987 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:35.524683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:35.548960 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.549525 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.550290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.551627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.552254 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.552942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.608573 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-23f431c5-6bd1-4c5b-875e-27f0c79aa6ac tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 204 len: 0 microversion: 2.1 time: 0.198249 Oct 23 02:20:35.610502 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 484/970] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:20:35 2022] DELETE /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:20:35.618757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:35.619509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:35.626900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.627430 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.628094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.628802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.629262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.629688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.835640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:35.842619 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cf85fb95-7deb-4b1c-93e4-2111b463ad46 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/os-volume_attachments/756777ac-c98e-4a41-85f2-a38cf9f9e956" status: 202 len: 0 microversion: 2.20 time: 0.322714 Oct 23 02:20:35.843868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 487/971] 10.222.0.23 () {60 vars in 1457 bytes} [Sun Oct 23 02:20:35 2022] DELETE /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/os-volume_attachments/756777ac-c98e-4a41-85f2-a38cf9f9e956 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:20:35.846968 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d5648b3e-3f2b-4f76-b6bb-40ead0e93da5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1680 microversion: 2.1 time: 0.229721 Oct 23 02:20:35.847750 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 485/972] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:35 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:35.858859 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:35.860873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:35.868615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.869649 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.870136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.871142 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.872692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.873649 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.913542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:35.914139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:35.920577 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.921070 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.921502 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.922194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:35.922673 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:35.923329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:35.953512 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118877) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 23 02:20:36.021539 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [169a9e27-ecf6-47f4-8e0a-61cd1a5288c0] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:20:36.097531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:36.105624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-dd8c1481-e1eb-4573-8cbe-d3421767f8c6 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.260157 Oct 23 02:20:36.106941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 488/973] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:35 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:36.871178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:36.872632 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:36.879617 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:36.880135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:36.880602 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:36.881315 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:36.881769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:36.882220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:37.030216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [169a9e27-ecf6-47f4-8e0a-61cd1a5288c0] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 37686. Oct 23 02:20:37.033626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4d213192-7f02-4c5d-a214-09003a737650 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "POST /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/action" status: 202 len: 0 microversion: 2.20 time: 1.124017 Oct 23 02:20:37.037612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 486/974] 10.222.0.23 () {62 vars in 1319 bytes} [Sun Oct 23 02:20:35 2022] POST /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/action => generated 0 bytes in 1129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:20:37.043142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:37.044484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:37.051270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:37.051950 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:37.052848 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:37.053449 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:37.054008 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:37.054575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:37.125476 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:37.138012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-817ee48b-79e9-4500-86b1-67d2dac97f55 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1680 microversion: 2.1 time: 0.270880 Oct 23 02:20:37.138633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 489/975] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:36 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1680 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:37.160001 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:37.160856 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:37.167162 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:37.167656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:37.168096 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:37.169420 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:37.169868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:37.170530 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:37.364192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:37.374321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:37.375855 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:37.377154 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c1bbf019-7081-4429-b57e-44c7ee1e3bf0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1673 microversion: 2.20 time: 0.338350 Oct 23 02:20:37.386561 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 487/976] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:37 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1673 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:37.739522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:37.748986 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-31cb9bcf-8f42-4495-a256-8de312d1d62e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.596858 Oct 23 02:20:37.750295 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 490/977] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:37 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:38.165388 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:38.166266 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:38.177211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:38.179296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:38.180006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:38.181548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:38.183413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:38.185474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:38.409908 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:38.412821 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:38.421148 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:38.422045 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:38.422873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:38.424010 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:38.424749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:38.425541 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:38.570488 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:38.585361 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d4602303-3b70-4249-860f-47ae766dfb48 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1680 microversion: 2.1 time: 0.423697 Oct 23 02:20:38.585984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 488/978] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:38 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1680 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:38.701666 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:38.716093 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:38.718026 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:38.738250 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-95417926-1905-42a1-b3f2-dba5ae386563 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1675 microversion: 2.20 time: 0.337254 Oct 23 02:20:38.739445 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 491/979] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:38 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1675 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:38.773050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:38.773651 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:38.784171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:38.784680 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:38.785100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:38.785981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:38.787645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:38.788251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:39.062416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:39.079395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-43ab0436-fcac-48dd-8516-7980313260ff tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.309983 Oct 23 02:20:39.080247 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 489/980] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:38 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:39.268301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-bbbfae06-6957-436a-9b63-b7d35a539533 req-dcca9c40-0bb4-4d41-bc4b-13a71acc40ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb9b7c7-7380-423a-b0c5-43e7d775e9e7", "name": "network-vif-deleted", "tag": "1cc48bf0-68f8-4f4c-ac88-de9210d7d765"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:39.278698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bbbfae06-6957-436a-9b63-b7d35a539533 req-dcca9c40-0bb4-4d41-bc4b-13a71acc40ad service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:39.279178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bbbfae06-6957-436a-9b63-b7d35a539533 req-dcca9c40-0bb4-4d41-bc4b-13a71acc40ad service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:39.279614 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-bbbfae06-6957-436a-9b63-b7d35a539533 req-dcca9c40-0bb4-4d41-bc4b-13a71acc40ad service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:39.295384 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-bbbfae06-6957-436a-9b63-b7d35a539533 req-dcca9c40-0bb4-4d41-bc4b-13a71acc40ad service nova] Creating event network-vif-deleted:1cc48bf0-68f8-4f4c-ac88-de9210d7d765 for instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 on hv-cinder-86149 Oct 23 02:20:39.302533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-bbbfae06-6957-436a-9b63-b7d35a539533 req-dcca9c40-0bb4-4d41-bc4b-13a71acc40ad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037440 Oct 23 02:20:39.308877 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 492/981] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:39.622572 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:39.624645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:39.635940 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:39.636685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:39.637815 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:39.639443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:39.640075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:39.648357 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:39.747443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:39.756415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5413fa56-5ca2-4761-b32f-00fc22c1a2b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1325 microversion: 2.1 time: 0.140605 Oct 23 02:20:39.757023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 490/982] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:39 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1325 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:39.771121 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:39.772446 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:39.781019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:39.781573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:39.782023 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:39.782781 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:39.783234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:39.783658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:40.017247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:40.038753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:40.040585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:40.042615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-516d677a-2dc5-4183-b1c8-d8d0e7c82b17 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.278728 Oct 23 02:20:40.044354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 493/983] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:39 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:40.103800 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:40.104855 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:40.115057 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:40.115622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:40.116127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:40.128326 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:40.147184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:40.147634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:40.371302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:40.379751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cdd58797-470a-4fb2-871d-61bacc33469a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.281228 Oct 23 02:20:40.380308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 491/984] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:40 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:40.787207 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:40.787207 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:40.790682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:40.791162 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:40.791941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:40.792853 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:40.794586 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:40.795018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:40.899345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:40.907714 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4a7751de-547d-4545-9e0b-cc2b7e3717b8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1325 microversion: 2.1 time: 0.130118 Oct 23 02:20:40.908290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 494/985] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:40 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1325 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:41.069210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:41.069757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:41.076583 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:41.077057 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:41.077485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:41.078358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:41.078872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:41.079290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:41.404537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:41.405472 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:41.412386 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:41.412989 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:41.413678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:41.414518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:41.415062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:41.415722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:41.642347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:41.655280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:41.657638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:41.658930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-666f3a2a-e537-490d-8982-2515cb802ec3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.593702 Oct 23 02:20:41.659976 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 492/986] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:41 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:41.789323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:41.798125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ae0e4b42-96e3-4459-a918-94e4e0cbda70 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.398319 Oct 23 02:20:41.798926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 495/987] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:41 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:41.931645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:41.932580 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:41.939823 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:41.940370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:41.940818 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:41.941517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:41.941966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:41.942599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:41.983238 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:41.984101 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:41.985149 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:41.985829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lazy-loading 'fault' on Instance uuid feb9b7c7-7380-423a-b0c5-43e7d775e9e7 {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:20:42.071954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:42.087896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-030a2456-d850-4464-9a0c-d8382301d987 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 200 len: 1330 microversion: 2.1 time: 0.160132 Oct 23 02:20:42.088476 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 493/988] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:41 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 1330 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:42.182755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:42.186285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:42.208704 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.210011 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.210473 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.211197 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.211656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.212096 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.250272 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d46de9e0-bd57-4658-a716-c1e257d4da1d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.072313 Oct 23 02:20:42.250993 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 496/989] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:20:42 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:42.398098 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:42.398629 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:42.408895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.409388 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.409822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.410563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.412793 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.414956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.465596 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cfb722f6-6960-4255-9730-87a746ed2d51 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/6d7b4001-220c-43d2-a8bf-56b678248e27" status: 200 len: 194 microversion: 2.1 time: 0.071077 Oct 23 02:20:42.466762 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 494/990] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Oct 23 02:20:42 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/6d7b4001-220c-43d2-a8bf-56b678248e27 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:42.477415 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:42.478327 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:42.488812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.489822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.491046 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.492028 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.492709 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.493433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.661581 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lazy-loading 'services' on Instance uuid 3b94295f-bde2-4165-bd9a-4763ac31fd9a {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:20:42.705043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:42.705683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:42.717652 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.721039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.721727 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.723111 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.725179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.725908 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.780827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:42.824844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-71a743a9-e814-4831-8483-2569f514c594 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/6d7b4001-220c-43d2-a8bf-56b678248e27" status: 202 len: 0 microversion: 2.1 time: 0.351216 Oct 23 02:20:42.825941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 497/991] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:20:42 2022] DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/6d7b4001-220c-43d2-a8bf-56b678248e27 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:20:42.839281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:42.840038 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:42.858481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.861128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.861592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.862324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:42.862814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:42.863248 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:42.884220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=91,nova_cell1:INSERT=4 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:43.088551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:43.110403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:43.111866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:43.113017 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-dff6b924-9773-4f42-a231-03ba8a9def43 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.419830 Oct 23 02:20:43.113574 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 495/992] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:42 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:20:43.156787 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:43.161030 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:43.181310 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:43.182127 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:43.182896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:43.187800 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:43.190067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:43.192329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:43.209428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:43.221636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6f649457-3704-4cd3-a34d-9498b4abe818 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.394292 Oct 23 02:20:43.222239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 498/993] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:42 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:43.243415 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 HTTP/1.1 Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:20:43.245981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:20:43.247605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'feb9b7c7-7380-423a-b0c5-43e7d775e9e7'} Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:20:43.248416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:20:43.249675 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:20:43.252882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:20:43.253861 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1a115b87-4b24-409b-a5d5-7bbe4b2199d6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 404 len: 111 microversion: 2.1 time: 0.117136 Oct 23 02:20:43.254744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 496/994] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:43 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:20:43.264338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fd301a84-657c-47e0-86f1-8d8ff2cd24fa tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '.version_select at 0x7f9da3096c10>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:43.298291 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fd301a84-657c-47e0-86f1-8d8ff2cd24fa tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-300045846" status: 202 len: 0 microversion: 2.1 time: 0.038856 Oct 23 02:20:43.299726 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 499/995] 10.222.0.23 () {58 vars in 1218 bytes} [Sun Oct 23 02:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-300045846 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:20:44.142359 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:44.143025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:44.154178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:44.154702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:44.155135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:44.155899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:44.156356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:44.156973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:44.247757 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:44.248636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:44.258526 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:44.263485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:44.264290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:44.265300 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:44.267044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:44.268143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:44.501766 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:44.517019 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:44.521571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:44.525952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9080f959-5cb2-4534-b887-17c43f6e781f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.387488 Oct 23 02:20:44.527594 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 497/996] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:44 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:44.583979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:44.601764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-071c3c8e-93e9-4469-bcc2-7b9fabead834 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.356857 Oct 23 02:20:44.616613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 500/997] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:44 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:44.623563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a554be76-d042-4918-9954-fb6f7a78732b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: .version_select at 0x7f9da2d9a8b0>, body: {"keypair": {"name": "tempest-keypair-1217992674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzMssC1UgUjv0h7Ak+XntTMXX1D6/hhSnWLfM4634oJnFBr1ffBjhoXy1W2Gm9b1rqRH7Ng+FeeRMSUG4Ehcf2ZGXZtwF4GBQ0lJ5A45/hXyATRzTWnwRyRGDOiENmu2w=="}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:44.655785 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-a554be76-d042-4918-9954-fb6f7a78732b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:20:44.661275 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-a554be76-d042-4918-9954-fb6f7a78732b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for user 66975cf6d8fa417e8df429d4c89ef910 and project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'key_pairs'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:20:44.710202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a554be76-d042-4918-9954-fb6f7a78732b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091036 Oct 23 02:20:44.711700 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 498/998] 10.222.0.23 () {60 vars in 1159 bytes} [Sun Oct 23 02:20:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:20:45.349662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-746dd7c6-4176-4cfb-924f-67b005584a4b req-b77e7f46-efce-4f2e-833d-21f4b863f46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa5faf5-5722-40fd-b4aa-c8a419e8c73d", "name": "network-vif-plugged", "status": "completed", "tag": "6ebd6dec-ed9e-49f3-9f6a-d935781e2f04"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:45.381841 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-746dd7c6-4176-4cfb-924f-67b005584a4b req-b77e7f46-efce-4f2e-833d-21f4b863f46e service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:45.382334 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-746dd7c6-4176-4cfb-924f-67b005584a4b req-b77e7f46-efce-4f2e-833d-21f4b863f46e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:45.387080 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-746dd7c6-4176-4cfb-924f-67b005584a4b req-b77e7f46-efce-4f2e-833d-21f4b863f46e service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:45.426758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-746dd7c6-4176-4cfb-924f-67b005584a4b req-b77e7f46-efce-4f2e-833d-21f4b863f46e service nova] Creating event network-vif-plugged:6ebd6dec-ed9e-49f3-9f6a-d935781e2f04 for instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d on hv-cinder-86149 Oct 23 02:20:45.439073 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-746dd7c6-4176-4cfb-924f-67b005584a4b req-b77e7f46-efce-4f2e-833d-21f4b863f46e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087369 Oct 23 02:20:45.440755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 501/999] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:20:45.553358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:45.554211 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:45.566685 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:45.567406 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:45.567928 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:45.568921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:45.597160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:45.597733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:45.642412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:45.643406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:45.662959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:45.663498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:45.663948 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:45.664683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:45.666485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:45.671687 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:46.227736 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:46.237545 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a9b55415-45de-4132-80c5-1928380633cc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.606431 Oct 23 02:20:46.238121 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 502/1000] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:45 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:46.263501 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:46.283892 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:46.285671 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:46.287337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cad96543-d193-433e-afc9-c0edb9f3cb70 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.738600 Oct 23 02:20:46.288445 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 499/1001] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:45 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:47.265932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:47.267175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:47.274654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:47.275283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:47.275979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:47.277354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:47.278029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:47.278570 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:47.316759 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-198220708", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7b3cf49-41ec-4949-b12a-aff94c1d3d94"}], "security_groups": [{"name": "tempest-securitygroup--2107939363"}], "key_name": "tempest-keypair-1217992674", "user_data": "}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:20:47.534559 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] validate_networks() for [('a7b3cf49-41ec-4949-b12a-aff94c1d3d94', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:20:47.611981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:47.619861 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d58cca70-7127-46ee-8f12-eaa842b4183c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.357994 Oct 23 02:20:47.620467 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 503/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:47 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:47.625166 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:47.625957 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:47.631729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:47.632219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:47.632658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:47.633516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:47.634113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:47.634745 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:47.849916 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:47.858625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:47.860082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:47.861517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c0d04682-9eaa-4bdb-a3ac-8db23e5bbc64 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.239666 Oct 23 02:20:47.861823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 504/1003] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:47 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:48.024304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:20:48.024721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:20:48.025186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:20:48.025589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:20:48.025994 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:20:48.035549 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:48.036013 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:48.036439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:48.037261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:48.037742 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:48.038181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:48.055163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:20:48.059358 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Getting quotas for user 66975cf6d8fa417e8df429d4c89ef910 and project eab81e47f8d6426fbd5b50d1eb7fc14a. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:20:48.062134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:48.076964 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:20:48.079319 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:20:48.128559 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-778043b8-8aac-4a1f-bba4-f2ecef4febd6 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.818513 Oct 23 02:20:48.129198 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 500/1004] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:20:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:20:48.141451 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6db226d1-cddb-45e9-bec3-233f5dd4fee9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:48.142068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6db226d1-cddb-45e9-bec3-233f5dd4fee9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:48.221549 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-6db226d1-cddb-45e9-bec3-233f5dd4fee9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:48.229492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6db226d1-cddb-45e9-bec3-233f5dd4fee9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1241 microversion: 2.1 time: 0.091834 Oct 23 02:20:48.230902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 505/1005] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:48 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:48.644043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:48.644753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:48.650727 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:48.651206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:48.652230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:48.653648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:48.654096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:48.654546 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:48.791790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:48.800349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-487d589f-7608-41b5-b9dd-5e49482be174 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.160641 Oct 23 02:20:48.809942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 501/1006] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:48 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:48.887023 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:48.887932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:48.899959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:48.900685 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:48.901338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:48.902603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:48.903188 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:48.903612 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:49.046887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:49.055459 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:49.057026 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:49.058931 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-da754537-75e6-4314-bd9d-bbb349ab5a57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.176307 Oct 23 02:20:49.059656 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 506/1007] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:48 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:49.253145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:49.253749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:49.259694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:49.260429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:49.260912 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:49.261825 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:49.262278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:49.262732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:49.331195 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:49.339838 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2f4b8c29-4aad-4586-af47-b64ecea3583f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.090552 Oct 23 02:20:49.340532 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 502/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:49 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:49.824374 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:49.824990 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:49.831054 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:49.831543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:49.831981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:49.832683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:49.833139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:49.833596 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:49.971417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:49.978995 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-42f218a7-8f64-46dd-a8e0-11e3d55808e7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.158627 Oct 23 02:20:49.980118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 507/1009] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:49 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:50.086119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:50.086771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:50.094598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:50.095084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:50.095522 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:50.096208 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:50.096659 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:50.097076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:50.229205 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:50.237370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:50.238839 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:50.239995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ca7a8a61-f538-4e07-8928-04993b541058 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.157701 Oct 23 02:20:50.240546 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 503/1010] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:50 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:50.363588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:50.364201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:50.371272 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:50.371774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:50.372208 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:50.372920 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:50.373373 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:50.373802 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:50.447433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:50.455893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-808c5453-985e-4620-88f7-08f75e3880d5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.096214 Oct 23 02:20:50.456483 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 508/1011] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:50 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:51.002265 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:51.003017 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:51.008962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:51.009443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:51.010133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:51.010855 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:51.011394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:51.011819 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:51.146855 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:51.157262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cc516f2a-b812-45a6-85d9-58b42403ac14 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.158641 Oct 23 02:20:51.158153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 504/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:50 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:51.265445 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:51.266030 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:51.272390 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:51.272877 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:51.273317 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:51.274022 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:51.274564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:51.274997 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:51.419320 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:51.428056 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:51.429496 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:51.430699 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a9ede5de-b2f1-4368-88e2-75cce4aa84e9 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.169266 Oct 23 02:20:51.434884 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 509/1013] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:51 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:51.480309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:51.480914 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:51.487304 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:51.487871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:51.488374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:51.489150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:51.489724 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:51.490213 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:51.557233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:51.565542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8ba8f021-e12e-4433-817e-5addb81d540d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.089174 Oct 23 02:20:51.566115 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 505/1014] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:51 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:52.181235 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:52.181849 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:52.188320 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:52.188805 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:52.189239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:52.189928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:52.190496 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:52.190928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:52.325119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:52.332980 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-576ffb88-151e-46fe-afcb-afa73f93f283 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.155649 Oct 23 02:20:52.333561 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 510/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:52 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:52.457073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:52.458532 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:52.472144 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:52.472607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:52.473046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:52.473806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:52.474290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:52.475299 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:52.591653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:52.592449 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:52.599340 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:52.599999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:52.600537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:52.601559 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:52.602265 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:52.602984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:52.666467 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:52.680600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:52.682425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:52.687331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e67bc5e1-70b0-4163-88af-891db2925be3 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.234370 Oct 23 02:20:52.689916 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 506/1016] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:52 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:20:52.690608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:52.699114 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d5c34934-4ae6-4b9b-b4b4-31051cc02ebd tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.113499 Oct 23 02:20:52.699715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 511/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:52 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:53.356882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:53.357861 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:53.364404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:53.364896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:53.365329 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:53.366028 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:53.366507 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:53.366931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:53.526348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:53.534326 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-46a7ca7b-c6a8-4d47-adad-5d21f9cad7bc tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.181798 Oct 23 02:20:53.534940 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 507/1018] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:53 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:53.714930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:53.715602 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:53.722968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:53.723644 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:53.724153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:53.724965 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:53.725154 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:53.725569 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:53.725769 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:53.726128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:53.732459 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:53.732973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:53.733403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:53.734094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:53.734587 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:53.735005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:53.832171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:53.840202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-27d68126-b9e8-45ca-a21c-6950a87e7ac1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.118718 Oct 23 02:20:53.840930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 508/1019] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:53 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:53.900528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:53.909275 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:53.910763 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:53.911917 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-467cdaee-c102-4fc7-af79-c5986c62706f tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.201763 Oct 23 02:20:53.912492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 512/1020] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:53 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:54.557072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:54.558293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:54.564941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:54.565429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:54.565864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:54.566596 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:54.567051 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:54.567474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:54.704102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:54.711855 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-dc49ac06-d4b1-47be-bce2-c1b74c8fb78c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.158646 Oct 23 02:20:54.712429 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 509/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:54 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:54.865722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:54.865722 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:54.872153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:54.872646 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:54.873078 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:54.873774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:54.874223 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:54.874674 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:54.937728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:54.938263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:54.945005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:54.945496 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:54.945936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:54.946683 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:54.947143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:54.947566 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:54.948635 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:54.960802 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a92af36d-719b-45d8-9774-5d3f1386f87c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.101301 Oct 23 02:20:54.965130 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 513/1022] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:54 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:55.089222 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:55.098663 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:55.100757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:55.102168 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-70575204-38ac-4687-ac78-fa0cd5c57f57 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.168458 Oct 23 02:20:55.102997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 510/1023] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:54 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 23 02:20:55.735241 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:55.735860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:55.741865 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:55.742355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:55.742844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:55.743538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:55.743999 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:55.744431 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:55.875039 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:55.882758 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4dbd711e-213f-4aba-b8fa-90e2276d9229 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.151370 Oct 23 02:20:55.883323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 514/1024] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:55 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:55.984915 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:55.985626 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:55.992046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:55.992519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:55.992943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:55.993640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:55.994082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:55.995093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:56.054192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:56.062246 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8821d298-3c97-46c1-a57f-4ad674ef5242 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.081186 Oct 23 02:20:56.062830 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 511/1025] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:55 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:56.127937 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:56.128579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:56.134801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:56.135740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:56.136128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:56.136824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:56.137283 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:56.137742 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:56.268501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:56.277260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:56.278743 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:56.279927 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-412d2054-c8ca-40b9-b44e-31a6b847edba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.155882 Oct 23 02:20:56.280494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 515/1026] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:56 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:56.907518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:56.908070 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:56.914096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:56.914609 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:56.915045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:56.915724 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:56.916174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:56.917088 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:57.046827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:57.054322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d2258c2c-6081-4ca1-b3c2-71441549ae1a tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.150785 Oct 23 02:20:57.054905 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 512/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:56 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:57.084298 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:57.084914 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:57.091346 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:57.091827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:57.092264 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:57.092949 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:57.093402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:57.093830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:57.158030 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:57.165599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b03798a6-5024-498a-9150-fb6a74573390 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.085183 Oct 23 02:20:57.166164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 516/1028] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:57 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:57.305149 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:57.305752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:57.311601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:57.312075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:57.312503 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:57.313174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:57.313621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:57.314036 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:57.440149 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:57.448274 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:57.449798 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:57.451043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3e261595-48bf-4856-89e3-7a7216cbb288 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.149892 Oct 23 02:20:57.451595 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 513/1029] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:57 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:58.077681 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:58.078334 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:58.084238 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:58.084721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:58.085269 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:58.085836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:58.086288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:58.086740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:58.101466 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:58.188794 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:58.189410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:58.191818 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:58.192648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=10 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:58.198712 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:58.199193 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:58.199631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:58.200321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:58.200773 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:58.201192 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:58.220907 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=100 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:58.225625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:58.230878 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:58.239098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-65ba625a-2bb2-4686-bf54-ff13970b801d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.165225 Oct 23 02:20:58.239680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 517/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:58 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:58.267638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:58.275150 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-eaa37ed7-8ef0-4380-a277-3ba42373b40b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.090156 Oct 23 02:20:58.275795 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 514/1031] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:58 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:20:58.476355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:58.477001 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:58.483698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:58.484185 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:58.484625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:58.485316 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:58.485772 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:58.486199 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:58.614510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:58.623124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:58.624554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:58.625703 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-db00e9b8-d051-4bf3-be6f-7533ab64e7ba tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.153242 Oct 23 02:20:58.626284 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 518/1032] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:58 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:20:59.262728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:59.263331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:59.269647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:59.270122 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:59.270575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:59.271248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:59.271694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:59.272119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:59.297045 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:59.297708 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:59.304115 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:59.304599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:59.305043 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:59.305728 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:59.306209 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:59.306814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:59.385721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:59.393313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2227b1a6-cdd9-4100-970c-b1c3147b185b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.100054 Oct 23 02:20:59.393895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 519/1033] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:59 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:59.427536 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:59.435648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-fbddbe6e-07e3-4220-af37-1d9f0d7ffda0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.177767 Oct 23 02:20:59.436228 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 515/1034] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:20:59 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:20:59.652256 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:20:59.652799 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:20:59.654671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:20:59.660136 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:59.660622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:59.661079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:59.661770 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:20:59.662225 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:20:59.662723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:20:59.792208 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:59.800286 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:59.801726 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:20:59.802911 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ab937143-c277-4c7a-8184-9e74883263ec tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.155224 Oct 23 02:20:59.803470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 520/1035] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:20:59 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:00.415489 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:00.416707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:00.423114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:00.423597 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:00.424035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:00.424711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:00.425162 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:00.425581 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:00.458073 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:00.458706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:00.466273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:00.466774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:00.467206 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:00.467904 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:00.468349 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:00.468767 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:00.484895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:00.492423 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f20053b4-6329-4f98-9512-14e04543c11f tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1245 microversion: 2.1 time: 0.080813 Oct 23 02:21:00.492997 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 516/1036] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:00 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:00.602732 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:00.610536 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cb6c0f78-22df-4a14-b505-d98ce036f2da tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.156262 Oct 23 02:21:00.611108 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 521/1037] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:00 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:21:00.828369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:00.828976 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:00.834892 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:00.835370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:00.835803 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:00.836480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:00.836934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:00.837351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:00.963938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:00.971942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:00.973378 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:00.974544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8ceb4b74-360d-4a8d-9e7a-be14e94560b0 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.150044 Oct 23 02:21:00.975100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 517/1038] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:00 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:01.516388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:01.516932 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:01.523298 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:01.523782 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:01.524220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:01.524909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:01.525488 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:01.525924 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:01.586285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:01.593824 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3522df88-b395-4c11-8ed7-a1263e639643 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1237 microversion: 2.1 time: 0.081363 Oct 23 02:21:01.594391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 522/1039] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:01 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:01.633007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:01.633619 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:01.640299 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:01.640778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:01.641212 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:01.641889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:01.642341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:01.642799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:01.776618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:01.784203 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-fc8252fb-6e12-4486-aa22-0a7ff0379348 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.155061 Oct 23 02:21:01.784755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 518/1040] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:01 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:01.999708 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:02.000319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:02.006181 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:02.006702 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:02.007147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:02.007836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:02.008286 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:02.008712 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:02.137740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:02.145885 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:02.147358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:02.148554 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-12d94426-43bc-444e-ab04-9f4033ce3a42 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.152828 Oct 23 02:21:02.149121 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 523/1041] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:01 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:02.617487 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:02.618099 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:02.624602 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:02.625079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:02.625514 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:02.626194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:02.626688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:02.627100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:02.687670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:02.695397 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a9acc240-5651-4035-bba6-782157d1d569 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1237 microversion: 2.1 time: 0.081809 Oct 23 02:21:02.695953 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 519/1042] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:02 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:02.807217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:02.807879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:02.815510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:02.816006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:02.816448 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:02.817150 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:02.817606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:02.818035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:02.947768 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:02.955403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-265365f7-7156-400b-b07b-e04d805ee1f5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.152720 Oct 23 02:21:02.955981 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 524/1043] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:02 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:03.173976 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:03.174574 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:03.180475 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:03.180949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:03.181441 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:03.182113 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:03.182588 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:03.183016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:03.308966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:03.316864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:03.318387 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:03.320491 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-212f1890-ca99-498b-96b6-7b0578f865e4 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.150212 Oct 23 02:21:03.321023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 520/1044] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:03 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:03.718194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:03.718833 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:03.724661 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:03.725140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:03.725566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:03.726247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:03.726717 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:03.727137 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:03.788249 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:03.796599 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-904d2f86-273b-446d-92dc-fad1bc32bec0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1293 microversion: 2.1 time: 0.082335 Oct 23 02:21:03.797160 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 525/1045] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:03 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:03.977871 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:03.979746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:03.986334 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:03.987059 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:03.987681 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:03.988364 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:03.988970 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:03.989562 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.124775 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:04.132297 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d6049d8a-2011-4414-81cb-5971cf7ca915 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.158230 Oct 23 02:21:04.132856 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 521/1046] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:03 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:04.345915 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:04.346474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:04.352501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:04.352977 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:04.353620 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.354085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:04.354560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:04.354982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.437074 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:04.437618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:04.443644 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:04.444122 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:04.444544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.445294 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:04.445664 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:04.446081 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.475982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4cf918ba-a3cf-4cc0-96cb-678ba15aae0d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/75472e38-1f0f-4790-bb9c-e842bfc0d705" status: 200 len: 194 microversion: 2.1 time: 0.042770 Oct 23 02:21:04.476558 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 522/1047] 10.222.0.23 () {58 vars in 1413 bytes} [Sun Oct 23 02:21:04 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/75472e38-1f0f-4790-bb9c-e842bfc0d705 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:21:04.487045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:04.487640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:04.491718 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:04.493671 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:04.494164 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:04.494967 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.495637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:04.496105 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:04.496504 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.500731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:04.502191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:04.503381 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ecba5015-fb63-454e-9725-4a34b018ef3a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.161458 Oct 23 02:21:04.503950 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 526/1048] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:04 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:04.583369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lazy-loading 'services' on Instance uuid 3b94295f-bde2-4165-bd9a-4763ac31fd9a {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:21:04.655171 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0721ee42-e76a-4d88-963a-97ceb840e3be tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/75472e38-1f0f-4790-bb9c-e842bfc0d705" status: 202 len: 0 microversion: 2.1 time: 0.171815 Oct 23 02:21:04.655743 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 523/1049] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:21:04 2022] DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments/75472e38-1f0f-4790-bb9c-e842bfc0d705 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 23 02:21:04.819894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:04.820515 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:04.827276 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:04.827762 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:04.828203 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.828892 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:04.829348 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:04.829775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:04.890012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:04.897490 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e6a1c3ee-0c5f-4585-9faa-f4dabaa8fdae tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1293 microversion: 2.1 time: 0.081464 Oct 23 02:21:04.898053 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 527/1050] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:04 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:05.156476 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:05.157202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:05.163292 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:05.163774 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:05.164380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:05.165084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:05.166079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:05.166533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:05.301072 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:05.309492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-14272d71-fd14-4af8-ad5f-e0663f16078e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1266 microversion: 2.1 time: 0.157781 Oct 23 02:21:05.310063 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 524/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:05 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:05.529519 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:05.530139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:05.536562 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:05.537052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:05.537498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:05.538338 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:05.538957 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:05.539501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:05.678606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:05.687140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:05.688564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:05.689710 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bed7897f-970e-4243-94fc-a4978b915443 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.164094 Oct 23 02:21:05.690268 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 528/1052] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:05 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:05.920443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:05.921075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:05.927410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:05.928205 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:05.928854 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:05.929566 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:05.930016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:05.930433 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:06.147553 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:06.155623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-32924764-e37d-4f72-a005-fd701e1df2db tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1293 microversion: 2.1 time: 0.239719 Oct 23 02:21:06.156181 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 525/1053] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:05 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1293 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:06.332436 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:06.333000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:06.339065 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:06.339547 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:06.339985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:06.340682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:06.341140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:06.341586 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:06.468145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:06.475843 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-69c6d4cd-9c0b-4b1b-8235-cb7d92f1fac0 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1453 microversion: 2.1 time: 0.147345 Oct 23 02:21:06.476425 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 529/1054] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:06 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:06.499143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:06.499749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:06.505645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:06.506125 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:06.506586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:06.507262 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:06.507713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:06.508134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:06.643303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:06.651445 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2154c989-1ab7-4d54-b0bd-9910d49b2dea tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1453 microversion: 2.1 time: 0.156131 Oct 23 02:21:06.652254 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 526/1055] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:06 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:06.716206 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:06.717477 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:06.725147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:06.726021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:06.726657 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:06.727579 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:06.729444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:06.729444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:06.897335 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:06.909191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:06.911145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:06.912743 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-420dfc35-95e5-4b30-9e07-c0d71d7b051e tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.200871 Oct 23 02:21:06.920615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 530/1056] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:06 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:07.180589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:07.181785 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:07.190066 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:07.191075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:07.192261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:07.193311 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:07.193983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:07.195018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:07.284039 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-730d7daf-3916-40da-8773-3d3345c46f81 req-459c7bff-3d02-4175-a772-6db63010e529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb83af-0870-4f45-9164-d5539f2d667a", "name": "network-vif-plugged", "status": "completed", "tag": "d1b009dc-238c-4b94-abcc-f85c7f608d94"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:07.315410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:07.321043 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-730d7daf-3916-40da-8773-3d3345c46f81 req-459c7bff-3d02-4175-a772-6db63010e529 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:07.327951 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c453d371-6201-4321-9c52-d4114beb9d35 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1299 microversion: 2.1 time: 0.152271 Oct 23 02:21:07.329318 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 527/1057] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:07 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1299 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:07.339063 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-730d7daf-3916-40da-8773-3d3345c46f81 req-459c7bff-3d02-4175-a772-6db63010e529 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:07.339680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-730d7daf-3916-40da-8773-3d3345c46f81 req-459c7bff-3d02-4175-a772-6db63010e529 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:07.368018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-730d7daf-3916-40da-8773-3d3345c46f81 req-459c7bff-3d02-4175-a772-6db63010e529 service nova] Creating event network-vif-plugged:d1b009dc-238c-4b94-abcc-f85c7f608d94 for instance 3fdb83af-0870-4f45-9164-d5539f2d667a on hv-cinder-86149 Oct 23 02:21:07.374584 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-730d7daf-3916-40da-8773-3d3345c46f81 req-459c7bff-3d02-4175-a772-6db63010e529 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094389 Oct 23 02:21:07.375606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 531/1058] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:07.940058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:07.941314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:07.948474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:07.949175 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:07.949772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:07.950664 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:07.951465 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:07.952043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:07.966313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:07.969016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:07.984313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:07.984814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:07.985483 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:07.986203 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:07.986690 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:07.987124 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.045226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-136ff5b2-60be-4c25-b42b-dbb40827f4e1 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083407 Oct 23 02:21:08.046238 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 532/1059] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:21:07 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:21:08.178876 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:08.181285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:08.189043 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.189647 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.190175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.190991 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.191528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.192247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.228192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-04beb5ab-e6ac-447f-9b2f-766e2fa2707f tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053689 Oct 23 02:21:08.229098 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 533/1060] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:21:08 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 23 02:21:08.304478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:08.304982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:08.311193 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.311689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.312130 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.312844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.313304 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.313737 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.340796 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:21:08.344028 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=100 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:08.428328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e02663da-54ce-4da9-9696-5197e0251e2e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 204 len: 0 microversion: 2.1 time: 0.127286 Oct 23 02:21:08.430127 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 534/1061] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:21:08 2022] DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 23 02:21:08.436829 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:08.437591 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:08.443516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.444185 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.444627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.445321 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.445982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.447027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.485824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:08.497668 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:08.499810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:08.501562 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-08a626de-9724-4379-b375-e3b73785fe65 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.565341 Oct 23 02:21:08.502303 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 528/1062] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:07 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:08.510859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:08.511736 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:08.520657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.521360 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.521789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.522504 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.522955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.523372 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.772752 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:08.782827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4a390a34-3ed5-4642-9122-fc635babe1b7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.350528 Oct 23 02:21:08.783619 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 535/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:08 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:08.798406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-411a4bed-82ef-4f18-8539-4296d8b668a3 req-5a216af6-fb16-4dbd-84f1-9f8396d8e576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa5faf5-5722-40fd-b4aa-c8a419e8c73d", "tag": "6ebd6dec-ed9e-49f3-9f6a-d935781e2f04"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:08.811751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-411a4bed-82ef-4f18-8539-4296d8b668a3 req-5a216af6-fb16-4dbd-84f1-9f8396d8e576 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:08.812576 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-411a4bed-82ef-4f18-8539-4296d8b668a3 req-5a216af6-fb16-4dbd-84f1-9f8396d8e576 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:08.813018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-411a4bed-82ef-4f18-8539-4296d8b668a3 req-5a216af6-fb16-4dbd-84f1-9f8396d8e576 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:08.827179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:08.827704 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-411a4bed-82ef-4f18-8539-4296d8b668a3 req-5a216af6-fb16-4dbd-84f1-9f8396d8e576 service nova] Creating event network-changed:6ebd6dec-ed9e-49f3-9f6a-d935781e2f04 for instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d on hv-cinder-86149 Oct 23 02:21:08.835987 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-411a4bed-82ef-4f18-8539-4296d8b668a3 req-5a216af6-fb16-4dbd-84f1-9f8396d8e576 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042918 Oct 23 02:21:08.837003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 536/1064] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:08.839123 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8066921e-1484-4cc7-a273-fcd05d59dd5c tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1675 microversion: 2.1 time: 0.334218 Oct 23 02:21:08.841148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 529/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:08 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1675 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:09.031802 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-a641bcc7-582a-4d1b-87e5-5d663e00edb1 req-208fa703-9f39-4515-849f-d1bb7f3937df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4456352-a66e-455c-bbec-3e8ea1a334ec", "tag": "74f1daea-22d2-425b-9fe5-f40d95839a20"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:09.041909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a641bcc7-582a-4d1b-87e5-5d663e00edb1 req-208fa703-9f39-4515-849f-d1bb7f3937df service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.042551 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a641bcc7-582a-4d1b-87e5-5d663e00edb1 req-208fa703-9f39-4515-849f-d1bb7f3937df service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.043092 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-a641bcc7-582a-4d1b-87e5-5d663e00edb1 req-208fa703-9f39-4515-849f-d1bb7f3937df service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.056416 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-a641bcc7-582a-4d1b-87e5-5d663e00edb1 req-208fa703-9f39-4515-849f-d1bb7f3937df service nova] Creating event network-changed:74f1daea-22d2-425b-9fe5-f40d95839a20 for instance f4456352-a66e-455c-bbec-3e8ea1a334ec on hv-cinder-86149 Oct 23 02:21:09.061364 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-a641bcc7-582a-4d1b-87e5-5d663e00edb1 req-208fa703-9f39-4515-849f-d1bb7f3937df service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034262 Oct 23 02:21:09.062261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 537/1066] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:09.528858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:09.529470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:09.535948 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.536434 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.536873 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.537559 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.538017 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.538486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.560887 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:09.681344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:09.691216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:09.692653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:09.693812 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-abfa438b-2bda-4747-a0fe-1fb4162ea59a tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.168917 Oct 23 02:21:09.694490 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 530/1067] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:09 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:09.810623 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:09.811323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:09.817645 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.818131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.818609 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.819299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.819748 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.820169 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.873015 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:09.873624 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:09.879715 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.880197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.880654 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.881336 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:09.881786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:09.882232 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:09.996572 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:10.005000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b637370c-0184-44e9-8827-e60bb2ed79b3 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.199490 Oct 23 02:21:10.005606 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 538/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:09 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:10.041586 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:10.049301 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2b18d7b9-77e6-476d-9a69-1ba3b6024819 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1675 microversion: 2.1 time: 0.180970 Oct 23 02:21:10.049864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 531/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:09 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:21:10.719117 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:10.719721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:10.726090 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:10.726581 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:10.727010 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:10.728419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:10.728867 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:10.729289 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:10.875018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:10.882983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:10.884977 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:10.886116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f41ff293-8793-4e11-9851-89719fa297f6 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.170938 Oct 23 02:21:10.886716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 539/1070] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:10 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:11.030806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:11.031425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:11.037971 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:11.038735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:11.039374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:11.040830 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:11.041300 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:11.041731 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:11.076009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:11.076776 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:11.083598 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:11.084206 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:11.084749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:11.085576 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:11.086135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:11.086723 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:11.374228 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:11.381840 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-14c49bd9-8a92-490d-a6b7-a7cf4ad8d2ad tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.356361 Oct 23 02:21:11.382368 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 532/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:11 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:11.392653 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:11.400642 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1e2435e2-f61f-4d12-8366-f80bd1cf95df tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1675 microversion: 2.1 time: 0.329525 Oct 23 02:21:11.401219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 540/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:11 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:11.911313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:11.912248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:11.918777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:11.919590 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:11.920090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:11.920848 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:11.921514 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:11.922122 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:12.272141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:12.283302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:12.285488 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:12.287103 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-92785aad-fb49-4183-b5e8-84acd82cf7bb tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1731 microversion: 2.20 time: 0.379576 Oct 23 02:21:12.288384 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 533/1073] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:11 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1731 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:12.407021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:12.407652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:12.416116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:12.416935 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:12.417381 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:12.420048 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:12.420522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:12.421140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:12.424995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:12.427207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:12.438328 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:12.439670 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:12.440126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:12.440983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:12.444505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:12.444968 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:12.590419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:12.603035 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-582e3150-bac1-4d7d-b769-d6e6da21b415 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1607 microversion: 2.1 time: 0.181490 Oct 23 02:21:12.620767 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 534/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:12 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1607 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:21:12.646689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-cf8fb3c5-8742-4bef-b8c1-2cfe6bddcc9d req-7934e7cc-eff6-405d-a285-e29db71e090a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b94295f-bde2-4165-bd9a-4763ac31fd9a", "name": "network-vif-deleted", "tag": "cc068410-7e76-4bd9-a360-1e98e4ff4392"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:12.670231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-cf8fb3c5-8742-4bef-b8c1-2cfe6bddcc9d req-7934e7cc-eff6-405d-a285-e29db71e090a service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:12.671677 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-cf8fb3c5-8742-4bef-b8c1-2cfe6bddcc9d req-7934e7cc-eff6-405d-a285-e29db71e090a service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:12.672707 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-cf8fb3c5-8742-4bef-b8c1-2cfe6bddcc9d req-7934e7cc-eff6-405d-a285-e29db71e090a service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:12.712819 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-cf8fb3c5-8742-4bef-b8c1-2cfe6bddcc9d req-7934e7cc-eff6-405d-a285-e29db71e090a service nova] Creating event network-vif-deleted:cc068410-7e76-4bd9-a360-1e98e4ff4392 for instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a on hv-cinder-86149 Oct 23 02:21:12.728261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-cf8fb3c5-8742-4bef-b8c1-2cfe6bddcc9d req-7934e7cc-eff6-405d-a285-e29db71e090a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102956 Oct 23 02:21:12.729182 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 535/1075] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:12.775057 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:12.789382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7fdb3afa-4e5b-4c52-9162-c5e7b1898b6a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.386789 Oct 23 02:21:12.791676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 541/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:12 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:13.320011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:13.320731 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:13.327587 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.328069 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.328495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.329183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.329631 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.330045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.464788 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:13.472702 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:13.474138 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:13.475293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-820670fa-0bfc-456c-b8c7-8f1bd62f0d3c tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1718 microversion: 2.20 time: 0.160030 Oct 23 02:21:13.475842 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 536/1077] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:21:13 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:21:13.655349 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:13.656068 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:13.663025 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.663440 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.663871 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.664593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.665041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.665460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.697900 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.698376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.698834 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.699277 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lazy-loading 'fault' on Instance uuid 3b94295f-bde2-4165-bd9a-4763ac31fd9a {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:21:13.741044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:13.748861 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f6120e5b-55ca-439c-a44a-351691f5f8a9 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1328 microversion: 2.1 time: 0.097844 Oct 23 02:21:13.749429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 542/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:13 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:13.814018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:13.814647 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:13.820714 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.821185 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.821607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.822337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:13.822805 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:13.823220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:13.953679 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:13.961164 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-06ff2d29-32db-4805-a9eb-f0e35cd33b9e tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.151094 Oct 23 02:21:13.961717 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 537/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:13 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:14.772474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:14.773119 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:14.779526 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:14.780009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:14.780448 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:14.781139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:14.781595 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:14.782027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:14.813410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:14.813916 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:14.814357 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:14.814835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lazy-loading 'fault' on Instance uuid 3b94295f-bde2-4165-bd9a-4763ac31fd9a {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:21:14.854211 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006623bab8f04f448edf0d43397192d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49a39f93e67c4d3f9529bdef5bb66b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:14.862562 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8e88a5bb-e094-4cf1-89ec-24f83b41eaaf tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 200 len: 1328 microversion: 2.1 time: 0.093947 Oct 23 02:21:14.863131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 543/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:14 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 1328 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:14.985344 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:14.986059 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:14.992426 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:14.992899 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:14.993324 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:14.994080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:14.994601 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:14.994982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:15.124240 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:15.131888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-786676f9-abd9-43fb-9f7d-ff78c4344e6b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.150436 Oct 23 02:21:15.132440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 538/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:14 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:15.888496 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:15.889118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:15.895578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:15.896065 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:15.896506 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:15.897200 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:15.897658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:15.898087 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:15.911082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] HTTP exception thrown: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Request method failure captured: Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a HTTP/1.1 Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLO_aoz5p5bXVEqg0WZvSqMbBxiyCqihYhh7dAVux3NfBK8OJja3daTauj7cALj8EwXC4tqR_I-5hgMjlGa7IKCiY_swwkLDnxKT8TRD_Lz94ToI2AZt6Or6F5h640urVOudgJHHpyXCzvCJmfBganf4n4D-Hrj9Oe5r8RZGNu_g1M Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:21:15.912715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 006623bab8f04f448edf0d43397192d8 Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:15.914460 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '3b94295f-bde2-4165-bd9a-4763ac31fd9a'} Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:21:15.915873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:15.917154 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:15.918537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Returning 404 to user: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:21:15.918537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c208d670-ec3e-4e8c-bb27-2b55507fa443 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 404 len: 111 microversion: 2.1 time: 0.030422 Oct 23 02:21:15.918537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 544/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:15 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:21:15.924299 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-63bac133-3d66-43f0-9873-eacde69bf9e6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '.version_select at 0x7f9da2d73790>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:15.943001 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-63bac133-3d66-43f0-9873-eacde69bf9e6 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626503905" status: 202 len: 0 microversion: 2.1 time: 0.022546 Oct 23 02:21:15.943546 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 539/1083] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 23 02:21:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626503905 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:21:16.154414 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:16.154975 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:16.161075 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:16.161565 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:16.162002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:16.162729 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:16.163182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:16.163612 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:16.297711 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:16.305375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8757ebd3-c212-486e-8b52-64da3681a86c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.154902 Oct 23 02:21:16.305943 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 545/1084] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:16 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:21:17.328975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:17.329594 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:17.335500 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:17.335981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:17.336422 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:17.337117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:17.337567 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:17.337991 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:17.585475 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:17.593648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f996328d-078c-4f97-8255-79603c1f986a tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.269280 Oct 23 02:21:17.594204 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 540/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:17 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:18.616864 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:18.617517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:18.625067 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:18.625557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:18.625996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:18.626731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:18.627192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:18.627625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:18.806388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:18.814062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b8dcf786-e853-43a9-bc80-f3e26c51c144 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.201046 Oct 23 02:21:18.815189 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 546/1086] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:18 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:18.846231 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:18.846746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:18.848694 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:18.853819 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:18.854293 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:18.855990 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:18.856689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:18.857136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:18.857554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:18.873754 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] HTTP exception thrown: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Request method failure captured: Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a HTTP/1.1 Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLO_aoz5p5bXVEqg0WZvSqMbBxiyCqihYhh7dAVux3NfBK8OJja3daTauj7cALj8EwXC4tqR_I-5hgMjlGa7IKCiY_swwkLDnxKT8TRD_Lz94ToI2AZt6Or6F5h640urVOudgJHHpyXCzvCJmfBganf4n4D-Hrj9Oe5r8RZGNu_g1M Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:21:18.875389 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 006623bab8f04f448edf0d43397192d8 Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.876777 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '3b94295f-bde2-4165-bd9a-4763ac31fd9a'} Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:21:18.877554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.878901 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.880129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Returning 404 to user: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:21:18.880129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-238fcd6a-a1e1-46d0-999a-f1d093cad62d tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 404 len: 111 microversion: 2.1 time: 0.035083 Oct 23 02:21:18.880588 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 541/1087] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:21:18 2022] DELETE /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:21:18.885595 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:18.886213 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 3b94295f-bde2-4165-bd9a-4763ac31fd9a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:18.892422 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:18.892906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:18.893344 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:18.894031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:18.894518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:18.894946 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:18.908573 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] HTTP exception thrown: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Request method failure captured: Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a HTTP/1.1 Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLO_aoz5p5bXVEqg0WZvSqMbBxiyCqihYhh7dAVux3NfBK8OJja3daTauj7cALj8EwXC4tqR_I-5hgMjlGa7IKCiY_swwkLDnxKT8TRD_Lz94ToI2AZt6Or6F5h640urVOudgJHHpyXCzvCJmfBganf4n4D-Hrj9Oe5r8RZGNu_g1M Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:21:18.910118 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 006623bab8f04f448edf0d43397192d8 Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.911698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '3b94295f-bde2-4165-bd9a-4763ac31fd9a'} Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:21:18.912654 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. Oct 23 02:21:18.914224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:18.916062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Returning 404 to user: Instance 3b94295f-bde2-4165-bd9a-4763ac31fd9a could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:21:18.916062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-23037f24-1abd-4f38-bd01-9a34f8ae79d8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a" status: 404 len: 111 microversion: 2.1 time: 0.030039 Oct 23 02:21:18.916062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 547/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:18 2022] GET /compute/v2.1/servers/3b94295f-bde2-4165-bd9a-4763ac31fd9a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:21:19.479941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-995327e7-cae3-4c4d-92d1-e2cf082a181c req-8a745905-5fad-41e1-9533-ab002b1f8fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4456352-a66e-455c-bbec-3e8ea1a334ec", "name": "network-vif-plugged", "status": "completed", "tag": "74f1daea-22d2-425b-9fe5-f40d95839a20"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:19.489570 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-995327e7-cae3-4c4d-92d1-e2cf082a181c req-8a745905-5fad-41e1-9533-ab002b1f8fb7 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:19.490067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-995327e7-cae3-4c4d-92d1-e2cf082a181c req-8a745905-5fad-41e1-9533-ab002b1f8fb7 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:19.490530 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-995327e7-cae3-4c4d-92d1-e2cf082a181c req-8a745905-5fad-41e1-9533-ab002b1f8fb7 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:19.506045 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-995327e7-cae3-4c4d-92d1-e2cf082a181c req-8a745905-5fad-41e1-9533-ab002b1f8fb7 service nova] Creating event network-vif-plugged:74f1daea-22d2-425b-9fe5-f40d95839a20 for instance f4456352-a66e-455c-bbec-3e8ea1a334ec on hv-cinder-86149 Oct 23 02:21:19.512826 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-995327e7-cae3-4c4d-92d1-e2cf082a181c req-8a745905-5fad-41e1-9533-ab002b1f8fb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037268 Oct 23 02:21:19.513576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 542/1089] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:19.836774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:19.837390 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:19.843903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:19.844390 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:19.844830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:19.845524 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:19.845977 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:19.846402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:19.977125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:19.985369 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b6ee55e1-0ced-4587-9455-dcbe4f62c2e7 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.152414 Oct 23 02:21:19.985860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 548/1090] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:19 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:20.061440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:20.062023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:20.069605 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:20.070233 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:20.070699 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:20.071395 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:20.071850 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:20.072277 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:20.085810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] HTTP exception thrown: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Request method failure captured: Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf HTTP/1.1 Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLO_aoz5p5bXVEqg0WZvSqMbBxiyCqihYhh7dAVux3NfBK8OJja3daTauj7cALj8EwXC4tqR_I-5hgMjlGa7IKCiY_swwkLDnxKT8TRD_Lz94ToI2AZt6Or6F5h640urVOudgJHHpyXCzvCJmfBganf4n4D-Hrj9Oe5r8RZGNu_g1M Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:21:20.087703 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 006623bab8f04f448edf0d43397192d8 Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.089135 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '973e0362-0459-4084-9f53-776ba26a7fbf'} Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:21:20.090622 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.092134 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.093716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Returning 404 to user: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:21:20.093716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e2aa51de-1731-4267-abff-a2baf675ae0e tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "DELETE /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 404 len: 111 microversion: 2.1 time: 0.032725 Oct 23 02:21:20.093716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 543/1091] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:21:20 2022] DELETE /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:21:20.097612 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:20.098229 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] [instance: 973e0362-0459-4084-9f53-776ba26a7fbf] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:20.105037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:20.105677 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:20.106765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:20.107472 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:20.107937 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:20.108367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:20.121497 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] HTTP exception thrown: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Request method failure captured: Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf HTTP/1.1 Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLO_aoz5p5bXVEqg0WZvSqMbBxiyCqihYhh7dAVux3NfBK8OJja3daTauj7cALj8EwXC4tqR_I-5hgMjlGa7IKCiY_swwkLDnxKT8TRD_Lz94ToI2AZt6Or6F5h640urVOudgJHHpyXCzvCJmfBganf4n4D-Hrj9Oe5r8RZGNu_g1M Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:21:20.123624 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/49a39f93e67c4d3f9529bdef5bb66b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: 49a39f93e67c4d3f9529bdef5bb66b4c Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeTestJSON-270912511 Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 006623bab8f04f448edf0d43397192d8 Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeTestJSON-270912511-project Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.125303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '973e0362-0459-4084-9f53-776ba26a7fbf'} Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:21:20.126368 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. Oct 23 02:21:20.127792 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:21:20.129163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] Returning 404 to user: Instance 973e0362-0459-4084-9f53-776ba26a7fbf could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:21:20.129163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ec3a92dd-264a-4164-88ff-a906efed23b8 tempest-AttachVolumeTestJSON-270912511 tempest-AttachVolumeTestJSON-270912511-project] 10.222.0.23 "GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf" status: 404 len: 111 microversion: 2.1 time: 0.031135 Oct 23 02:21:20.129163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 549/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:20 2022] GET /compute/v2.1/servers/973e0362-0459-4084-9f53-776ba26a7fbf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:21:21.009132 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:21.009830 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:21.019709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:21.020541 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:21.021462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:21.022701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:21.023878 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:21.024270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:21.163936 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:21.171750 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-484f024b-6a71-43f4-a4e8-ae0aa98dcb13 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1367 microversion: 2.1 time: 0.166740 Oct 23 02:21:21.172315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 544/1093] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:21 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:22.197296 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:22.197956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:22.205812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:22.206593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:22.207251 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:22.208174 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:22.208982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:22.209638 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:22.366190 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:22.384179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-150dbb3c-f6f4-4443-ab8c-6b1feb46b879 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1557 microversion: 2.1 time: 0.192150 Oct 23 02:21:22.385156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 550/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:22 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1557 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:21:22.409091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:22.409643 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:22.417369 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:22.422713 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:22.423214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:22.423966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:22.425046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:22.425667 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:22.514373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-488e1991-4287-433d-a9e5-7d79421c7100 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109426 Oct 23 02:21:22.514999 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 545/1095] 10.222.0.23 () {58 vars in 1275 bytes} [Sun Oct 23 02:21:22 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:23.837294 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-1add1f17-ab00-4ec0-86a6-26d77e11e49a req-1a2dff53-7526-454b-b0ec-8fa2148b8b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4456352-a66e-455c-bbec-3e8ea1a334ec", "tag": "74f1daea-22d2-425b-9fe5-f40d95839a20"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:23.849141 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-1add1f17-ab00-4ec0-86a6-26d77e11e49a req-1a2dff53-7526-454b-b0ec-8fa2148b8b23 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:23.849633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-1add1f17-ab00-4ec0-86a6-26d77e11e49a req-1a2dff53-7526-454b-b0ec-8fa2148b8b23 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:23.850072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-1add1f17-ab00-4ec0-86a6-26d77e11e49a req-1a2dff53-7526-454b-b0ec-8fa2148b8b23 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:23.862522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-1add1f17-ab00-4ec0-86a6-26d77e11e49a req-1a2dff53-7526-454b-b0ec-8fa2148b8b23 service nova] Creating event network-changed:74f1daea-22d2-425b-9fe5-f40d95839a20 for instance f4456352-a66e-455c-bbec-3e8ea1a334ec on hv-cinder-86149 Oct 23 02:21:23.868029 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-1add1f17-ab00-4ec0-86a6-26d77e11e49a req-1a2dff53-7526-454b-b0ec-8fa2148b8b23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035090 Oct 23 02:21:23.868763 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 551/1096] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:21:40.319401 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=9 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:40.320194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=68 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:40.324650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:21:40.326852 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:40.333544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:40.334025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:40.334474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:40.335162 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:40.335612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:40.336037 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:40.407734 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a4e24c2e-6fe4-429b-af48-4e1bbed34876 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "POST /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/action" status: 202 len: 0 microversion: 2.1 time: 0.089945 Oct 23 02:21:40.408356 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 546/1097] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:21:40 2022] POST /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:21:40.414879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:40.415626 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:21:40.420169 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:40.420881 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:40.429733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:40.430317 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:40.430841 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:40.431648 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:40.432155 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:40.432764 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:40.582171 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:40.590421 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5a402a10-6cdc-4f9d-b0f5-1cfc6ec9388d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1749 microversion: 2.1 time: 0.177608 Oct 23 02:21:40.591020 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 552/1098] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:40 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1749 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:41.614041 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:41.614758 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:41.621307 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:41.621775 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:41.622202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:41.622905 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:41.623349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:41.623761 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:41.770207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:41.779128 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f3fb66cf-b758-4b33-89b4-b1bcbfdf0715 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1749 microversion: 2.1 time: 0.169290 Oct 23 02:21:41.779689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 547/1099] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:41 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:42.802203 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:42.802853 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:42.810003 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:42.810505 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:42.810956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:42.811622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:42.812066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:42.812486 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:42.955637 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:42.963693 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f50ccb75-31c6-425c-8cad-fd5e79b2481b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1749 microversion: 2.1 time: 0.165342 Oct 23 02:21:42.964255 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 553/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:42 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:43.986801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:43.987443 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:43.993744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:43.994219 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:43.994710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:43.995407 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:43.995858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:43.996341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:44.202341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:44.211108 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-dc7408fc-9220-486e-990f-3e96e8f7771b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1749 microversion: 2.1 time: 0.228073 Oct 23 02:21:44.211891 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 548/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:43 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1749 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:45.236304 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:45.237496 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:45.243951 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:45.244438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:45.244873 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:45.245567 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:45.246735 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:45.246735 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:45.390974 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:45.399087 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-686a1b69-0a11-4f1a-babd-8a112eb72e50 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.167825 Oct 23 02:21:45.399665 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 554/1102] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:45 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:46.423022 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:46.423645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:46.429910 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:46.430382 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:46.430843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:46.431515 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:46.431958 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:46.432373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:46.578944 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:46.587137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a341a2e3-dd0f-4391-a3a3-1d6b5a08e2c8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.168058 Oct 23 02:21:46.587700 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 549/1103] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:46 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:47.610537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:47.611158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:47.617552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:47.618032 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:47.618488 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:47.619178 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:47.619636 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:47.620061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:47.763550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:47.771628 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-da140ca1-bbd1-4979-9c79-98f973ef4435 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.164934 Oct 23 02:21:47.772194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 555/1104] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:47 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:48.795960 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:48.796595 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:48.802966 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:48.803448 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:48.803883 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:48.804563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:48.805043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:48.805467 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:48.950929 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:48.959252 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d7b09d2b-9066-4646-9626-cfe2cc8899a9 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.167753 Oct 23 02:21:48.959816 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 550/1105] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:48 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:49.983766 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:49.984388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:49.990753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:49.991237 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:49.991673 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:49.992363 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:49.992814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:49.993239 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:50.134501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:50.143224 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-b2585571-b789-4435-9be9-ecf8bb7341c3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.163846 Oct 23 02:21:50.143794 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 556/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:49 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:51.167064 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:51.167759 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:51.174864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:51.175342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:51.175771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:51.176470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:51.176896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:51.177312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:51.325603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:51.333964 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2dc7da6d-0301-45f8-96dd-89b026122053 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.170910 Oct 23 02:21:51.334555 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 551/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:51 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:52.358578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:52.359361 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:52.365183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:52.365664 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:52.366094 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:52.366811 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:52.367260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:52.367682 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:52.528307 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:52.539918 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f754f860-bc07-4915-872d-0b57a9047201 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.185693 Oct 23 02:21:52.541806 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 557/1108] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:52 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:53.567981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:53.568610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:53.576126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:53.576600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:53.577029 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:53.577714 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:53.578161 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:53.578606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:53.720726 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:53.728755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d6f47bc3-a415-4cb0-bf76-bebdb99c4de8 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.164665 Oct 23 02:21:53.729315 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 552/1109] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:53 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:54.752246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:54.752898 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:54.759531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:54.760017 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:54.760456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:54.761140 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:54.761596 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:54.762059 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:54.906771 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:54.914894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e2600bcf-9258-4e62-83a5-2cedee372597 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.166476 Oct 23 02:21:54.915476 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 558/1110] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:54 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:55.937523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:55.938133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:55.944513 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:55.944994 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:55.945427 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:55.946113 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:55.946597 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:55.947025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:56.086543 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:56.095273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-184fc3a2-6c37-4a08-8613-1abe7ca9ecd1 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.161660 Oct 23 02:21:56.095824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 553/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:55 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:57.118325 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:57.118973 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:57.125858 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:57.126342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:57.126813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:57.127501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:57.127959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:57.128382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:57.517044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:57.525201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-ebbcb357-0fac-48f4-8ed4-c729e03408ec tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.410804 Oct 23 02:21:57.525774 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 559/1112] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:57 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:58.550305 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:58.550915 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:58.557177 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:58.557651 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:58.558944 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:58.559664 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:58.560115 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:58.560532 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:58.698410 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:58.707446 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d9e88f62-0c4a-4c5b-a0d2-8e3836e3b5a4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.162378 Oct 23 02:21:58.708004 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 554/1113] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:58 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:21:59.731090 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:21:59.731703 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:21:59.738153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:59.738671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:59.739107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:59.739793 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:21:59.740246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:21:59.740670 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:21:59.882320 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:21:59.891258 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-554c038c-d721-4ea4-9d4a-5204fa53059b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.164078 Oct 23 02:21:59.891834 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 560/1114] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:21:59 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:00.915330 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:00.916092 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:00.923374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:00.923846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:00.924272 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:00.924947 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:00.925392 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:00.925809 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:01.066880 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:01.075592 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5927461f-e6be-43a7-af0f-82e1654ef0ac tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.164169 Oct 23 02:22:01.076159 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 555/1115] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:00 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:02.099287 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:02.099834 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:02.107311 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:02.107787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:02.108219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:02.108899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:02.109404 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:02.109769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:02.255631 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:02.264480 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7932ebe5-df12-4890-a7f8-d4fafe8a5ea5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.169114 Oct 23 02:22:02.265052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 561/1116] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:02 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:03.287600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:03.288210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:03.295524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:03.296008 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:03.296442 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:03.297129 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:03.297579 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:03.298000 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:03.436542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:03.444650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9c79a425-1bef-4ae0-8030-0f130ced2e9b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.160900 Oct 23 02:22:03.445214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 556/1117] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:03 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:04.469434 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:04.470116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:04.477104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:04.477535 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:04.478002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:04.478813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:04.479267 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:04.479692 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:04.631246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:04.642601 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4973c176-489e-4832-ade2-e42aab2eb03f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.177316 Oct 23 02:22:04.643228 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 562/1118] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:04 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:05.669376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:05.669988 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:05.676414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:05.676895 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:05.677327 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:05.678006 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:05.678523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:05.678949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:05.831783 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:05.840799 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8c363745-bfc6-4795-884f-6c2a2a95ad87 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.174581 Oct 23 02:22:05.841367 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 557/1119] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:05 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:06.864803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:06.865422 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:06.871845 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:06.872328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:06.872765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:06.873453 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:06.873905 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:06.874330 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:07.016393 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:07.024516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0d79e91b-da33-4097-b48d-65cda4ff9fdd tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.163626 Oct 23 02:22:07.025090 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 563/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:06 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:08.049058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:08.049654 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:08.055930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:08.056406 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:08.056836 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:08.057510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:08.057956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:08.058382 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:08.201087 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:08.209194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8e4b966d-9090-4944-a582-234b61ae9bc6 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.164166 Oct 23 02:22:08.209757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 558/1121] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:08 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:09.233437 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:09.234046 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:09.240395 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:09.240877 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:09.241319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:09.242014 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:09.242485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:09.242914 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:09.436559 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:09.444788 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5961f3a9-c783-45fe-9bc6-8745d252e399 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1754 microversion: 2.1 time: 0.215509 Oct 23 02:22:09.445370 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 564/1122] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:09 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:10.467701 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:10.468149 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:10.470562 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=27 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:10.475852 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:10.476330 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:10.476756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:10.477442 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:10.477889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:10.478309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:10.483551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:10.624906 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:10.633411 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9d5aa90c-4535-4ce0-bcd7-f4bfc490fb55 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1757 microversion: 2.1 time: 0.169775 Oct 23 02:22:10.633962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 559/1123] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:22:10 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:47.156417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:47.158716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:47.160745 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=26 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:47.161516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=78 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:47.167125 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:47.167610 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:47.168048 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:47.168741 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:47.169192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:47.169620 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:47.198835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d5226148-970b-42ef-9b7c-0d6371f901da tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046390 Oct 23 02:22:47.199319 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 565/1124] 10.222.0.23 () {60 vars in 1343 bytes} [Sun Oct 23 02:22:47 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:22:47.264755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:47.265268 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:47.268563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:47.269174 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=5 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:22:47.274677 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:47.275155 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:47.275585 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:47.276266 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:47.276741 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:47.277162 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:47.302014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Going to try to terminate instance {{(pid=118877) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:22:47.377751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9519d0c6-fe38-4e27-9796-63fa5a4c20ee tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 204 len: 0 microversion: 2.20 time: 0.116464 Oct 23 02:22:47.378483 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 560/1125] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 23 02:22:47 2022] DELETE /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 02:22:47.386566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:47.387187 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:47.393558 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:47.394040 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:47.394522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:47.395214 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:47.395671 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:47.396100 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:47.526830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:47.534993 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:47.536445 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:47.537585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-06a792ac-fbb4-4315-a1c5-7a6a27151b94 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.154902 Oct 23 02:22:47.538164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 566/1126] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:22:47 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:22:48.564554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:48.565241 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:48.572279 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:48.572816 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:48.573264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:48.573994 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:48.574522 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:48.575016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:48.708058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:48.716161 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:48.717617 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:48.718797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-7f41e42c-1424-444e-bc06-f5c2ae76885d tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.159216 Oct 23 02:22:48.719352 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 561/1127] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:22:48 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:22:49.744108 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:49.744731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:49.752753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:49.753260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:49.753911 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:49.754813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:49.755466 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:49.756085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:49.975716 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:49.983959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:49.986194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:49.987503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-32a4117b-87fd-479c-8ebe-7f07a11dd744 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1724 microversion: 2.20 time: 0.247364 Oct 23 02:22:49.988082 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 567/1128] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:22:49 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:22:50.698921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-a82a539b-1ce1-41ad-9e3b-7de4667d3809 req-84b2f2f3-aa06-4bf4-a2bd-ec8eaa67b131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fdb83af-0870-4f45-9164-d5539f2d667a", "name": "network-vif-deleted", "tag": "d1b009dc-238c-4b94-abcc-f85c7f608d94"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:22:50.710143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a82a539b-1ce1-41ad-9e3b-7de4667d3809 req-84b2f2f3-aa06-4bf4-a2bd-ec8eaa67b131 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:50.710820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a82a539b-1ce1-41ad-9e3b-7de4667d3809 req-84b2f2f3-aa06-4bf4-a2bd-ec8eaa67b131 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:50.711258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-a82a539b-1ce1-41ad-9e3b-7de4667d3809 req-84b2f2f3-aa06-4bf4-a2bd-ec8eaa67b131 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:50.726307 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-a82a539b-1ce1-41ad-9e3b-7de4667d3809 req-84b2f2f3-aa06-4bf4-a2bd-ec8eaa67b131 service nova] Creating event network-vif-deleted:d1b009dc-238c-4b94-abcc-f85c7f608d94 for instance 3fdb83af-0870-4f45-9164-d5539f2d667a on hv-cinder-86149 Oct 23 02:22:50.731566 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-a82a539b-1ce1-41ad-9e3b-7de4667d3809 req-84b2f2f3-aa06-4bf4-a2bd-ec8eaa67b131 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210942 Oct 23 02:22:50.733142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 562/1129] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:22:51.013463 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:51.013998 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:51.020898 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:51.021394 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:51.021835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:51.022566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:51.023022 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:51.023452 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:51.053577 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:51.054066 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:51.054536 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:51.054990 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lazy-loading 'fault' on Instance uuid 3fdb83af-0870-4f45-9164-d5539f2d667a {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:22:51.099553 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:51.107911 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:51.109358 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9dba6c5f7e9472faa5aa963758d78fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4d62bf272e4ce69022518ff362813f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:22:51.111225 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-a3f48148-3a56-460b-a005-4965359dbc80 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 200 len: 1372 microversion: 2.20 time: 0.101211 Oct 23 02:22:51.112226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 568/1130] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:22:51 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 23 02:22:52.138225 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:52.139060 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:52.146048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:52.146557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:52.146993 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:52.147677 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:52.148126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:52.148548 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:52.163005 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] HTTP exception thrown: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Request method failure captured: Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a HTTP/1.1 Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLIGEqQmwUSJthYJwlvsBnS0vL1IeeZm_XKB7TVg9iFJh5_GjgO5d9ODbvXHqflrzLn1EtcEgbLu3nQEJ7RX5_05-Og4tYU_zlN2rM6fKlA68rtW-UQDoQzGBqml7oqSfXwsaatmOXLV8sI67nA3Vs7vxisi392Xc5SjjmsqaqCpcs Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:22:52.164732 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: c9dba6c5f7e9472faa5aa963758d78fe Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:52.166338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '3fdb83af-0870-4f45-9164-d5539f2d667a'} Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:22:52.167289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:52.168637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:52.169827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Returning 404 to user: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:22:52.169827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-22d1f4f2-693b-4399-a46d-6bb1f9a666ae tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 404 len: 111 microversion: 2.20 time: 0.032591 Oct 23 02:22:52.170249 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 563/1131] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:22:52 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:22:52.175478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3586b222-0369-4138-bac3-c30ef668e8b5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '.version_select at 0x7f9da309d040>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:52.195717 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3586b222-0369-4138-bac3-c30ef668e8b5 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406277432" status: 204 len: 0 microversion: 2.20 time: 0.023989 Oct 23 02:22:52.196298 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 569/1132] 10.222.0.23 () {60 vars in 1262 bytes} [Sun Oct 23 02:22:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406277432 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 23 02:22:54.035873 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:54.036375 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:54.042698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:54.043179 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:54.043611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:54.044291 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:54.044740 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:54.045160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:54.058723 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] HTTP exception thrown: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Request method failure captured: Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a HTTP/1.1 Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLIGEqQmwUSJthYJwlvsBnS0vL1IeeZm_XKB7TVg9iFJh5_GjgO5d9ODbvXHqflrzLn1EtcEgbLu3nQEJ7RX5_05-Og4tYU_zlN2rM6fKlA68rtW-UQDoQzGBqml7oqSfXwsaatmOXLV8sI67nA3Vs7vxisi392Xc5SjjmsqaqCpcs Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:22:54.060289 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: c9dba6c5f7e9472faa5aa963758d78fe Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.061962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '3fdb83af-0870-4f45-9164-d5539f2d667a'} Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:22:54.062876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.064137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.066550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Returning 404 to user: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:22:54.066550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-92b1b05e-0d53-483b-ab4c-043cad5679ea tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 404 len: 111 microversion: 2.20 time: 0.029633 Oct 23 02:22:54.066550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 564/1133] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 23 02:22:54 2022] DELETE /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:22:54.071139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:54.071755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 3fdb83af-0870-4f45-9164-d5539f2d667a] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:54.078613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:54.079099 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:54.079538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:54.080230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:54.081521 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:54.081732 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:54.094538 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] HTTP exception thrown: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Request method failure captured: Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a HTTP/1.1 Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLIGEqQmwUSJthYJwlvsBnS0vL1IeeZm_XKB7TVg9iFJh5_GjgO5d9ODbvXHqflrzLn1EtcEgbLu3nQEJ7RX5_05-Og4tYU_zlN2rM6fKlA68rtW-UQDoQzGBqml7oqSfXwsaatmOXLV8sI67nA3Vs7vxisi392Xc5SjjmsqaqCpcs Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:22:54.096220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: c9dba6c5f7e9472faa5aa963758d78fe Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.098002 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '3fdb83af-0870-4f45-9164-d5539f2d667a'} Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:22:54.099270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. Oct 23 02:22:54.100890 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:54.102290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Returning 404 to user: Instance 3fdb83af-0870-4f45-9164-d5539f2d667a could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:22:54.102290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-194f8bee-4db7-4d0c-a275-8e1a97f13961 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a" status: 404 len: 111 microversion: 2.20 time: 0.030967 Oct 23 02:22:54.102290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 570/1134] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:22:54 2022] GET /compute/v2.1/servers/3fdb83af-0870-4f45-9164-d5539f2d667a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 23 02:22:55.236188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:55.236716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:55.242994 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:55.243467 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:55.243898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:55.244578 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:55.245023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:55.245439 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:55.259308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] HTTP exception thrown: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Request method failure captured: Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 HTTP/1.1 Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKLIGEqQmwUSJthYJwlvsBnS0vL1IeeZm_XKB7TVg9iFJh5_GjgO5d9ODbvXHqflrzLn1EtcEgbLu3nQEJ7RX5_05-Og4tYU_zlN2rM6fKlA68rtW-UQDoQzGBqml7oqSfXwsaatmOXLV8sI67nA3Vs7vxisi392Xc5SjjmsqaqCpcs Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:22:55.260820 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: c9dba6c5f7e9472faa5aa963758d78fe Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.262505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '847628be-0620-4309-99c8-6036d43d26f7'} Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:22:55.263394 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.264879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.266332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Returning 404 to user: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:22:55.266332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1033a718-56b8-475a-9cc5-759e1fbdc779 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "DELETE /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 404 len: 111 microversion: 2.20 time: 0.029811 Oct 23 02:22:55.266332 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 565/1135] 10.222.0.23 () {60 vars in 1280 bytes} [Sun Oct 23 02:22:55 2022] DELETE /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:22:55.271147 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:22:55.271761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] [instance: 847628be-0620-4309-99c8-6036d43d26f7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:22:55.278197 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:55.278725 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:55.279165 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:55.279857 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:22:55.280308 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:22:55.280733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:22:55.294684 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] HTTP exception thrown: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Request method failure captured: Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 HTTP/1.1 Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKLIGEqQmwUSJthYJwlvsBnS0vL1IeeZm_XKB7TVg9iFJh5_GjgO5d9ODbvXHqflrzLn1EtcEgbLu3nQEJ7RX5_05-Og4tYU_zlN2rM6fKlA68rtW-UQDoQzGBqml7oqSfXwsaatmOXLV8sI67nA3Vs7vxisi392Xc5SjjmsqaqCpcs Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Openstack-Nova-Api-Version: 2.20 Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:22:55.296222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fa4d62bf272e4ce69022518ff362813f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: fa4d62bf272e4ce69022518ff362813f Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-42513205 Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: c9dba6c5f7e9472faa5aa963758d78fe Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeShelveTestJSON-42513205-project Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.297893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '847628be-0620-4309-99c8-6036d43d26f7'} Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:22:55.298814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. Oct 23 02:22:55.300037 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:22:55.301481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] Returning 404 to user: Instance 847628be-0620-4309-99c8-6036d43d26f7 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:22:55.301481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-7e2d9d8b-1f13-4f44-bb07-df87d816b033 tempest-AttachVolumeShelveTestJSON-42513205 tempest-AttachVolumeShelveTestJSON-42513205-project] 10.222.0.23 "GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7" status: 404 len: 111 microversion: 2.20 time: 0.031044 Oct 23 02:22:55.301481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 571/1136] 10.222.0.23 () {60 vars in 1277 bytes} [Sun Oct 23 02:22:55 2022] GET /compute/v2.1/servers/847628be-0620-4309-99c8-6036d43d26f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 23 02:23:24.539399 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1167215826", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452"}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:24.546642 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:24.548143 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:24.596056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] validate_networks() for None {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:23:24.870786 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:23:24.871235 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:23:24.871708 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:23:24.872111 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:23:24.872520 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:23:24.882603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:24.883078 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:24.883505 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:24.884216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:24.884661 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:24.885079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:24.903346 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Getting quotas for project 432641cf60c943ac810f1c55defbf4e0. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:23:24.908091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Getting quotas for user 52a62b82d2514ec785e69c61b069bff8 and project 432641cf60c943ac810f1c55defbf4e0. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:23:24.918778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:23:24.921025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:23:24.971751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-51fd7a53-0a61-4a2d-b340-6f0419c27236 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.436045 Oct 23 02:23:24.972309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 566/1137] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:23:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:23:24.983439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4d9d59f1-6920-4ae1-b833-aeeec9b01f91 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:24.984170 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4d9d59f1-6920-4ae1-b833-aeeec9b01f91 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:24.991720 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:24.997246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=30 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:24.998164 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 23 02:23:24.998387 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Sun Oct 23 02:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df (ip 10.222.0.23) !!! Oct 23 02:23:25.059707 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4d9d59f1-6920-4ae1-b833-aeeec9b01f91 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:25.068534 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4d9d59f1-6920-4ae1-b833-aeeec9b01f91 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1215 microversion: 2.1 time: 0.089071 Oct 23 02:23:25.069105 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 572/1138] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:24 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:26.091877 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:26.092473 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:26.100947 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:26.101478 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:26.103038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:26.103733 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:26.104190 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:26.104611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:26.168834 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:26.176464 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a9b1ce14-38d7-4b53-96f8-2c3a5235e0f8 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1267 microversion: 2.1 time: 0.088421 Oct 23 02:23:26.177017 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 567/1139] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:26 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:27.200596 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:27.201876 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:27.211405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:27.211891 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:27.212331 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:27.213021 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:27.213651 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:27.214069 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:27.435732 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:27.444625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-66fc3d0e-ae08-4822-8aaf-8a568730ae2a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.248378 Oct 23 02:23:27.445313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 573/1140] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:27 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:23:27.996428 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-9b968197-27db-46d4-b087-afaabcf219c0 req-b3011606-22ff-4713-9406-fa29b8e39f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9998bce-326b-428b-918a-98a6687d70df", "tag": "ef16eb1f-55cf-490d-b282-8bfea6551a1b"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:28.010940 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9b968197-27db-46d4-b087-afaabcf219c0 req-b3011606-22ff-4713-9406-fa29b8e39f94 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:28.011446 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9b968197-27db-46d4-b087-afaabcf219c0 req-b3011606-22ff-4713-9406-fa29b8e39f94 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:28.011878 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9b968197-27db-46d4-b087-afaabcf219c0 req-b3011606-22ff-4713-9406-fa29b8e39f94 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:28.024348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-9b968197-27db-46d4-b087-afaabcf219c0 req-b3011606-22ff-4713-9406-fa29b8e39f94 service nova] Creating event network-changed:ef16eb1f-55cf-490d-b282-8bfea6551a1b for instance d9998bce-326b-428b-918a-98a6687d70df on hv-cinder-86149 Oct 23 02:23:28.029173 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-9b968197-27db-46d4-b087-afaabcf219c0 req-b3011606-22ff-4713-9406-fa29b8e39f94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038055 Oct 23 02:23:28.029986 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 568/1141] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:28.469537 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:28.470163 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:28.477232 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:28.477715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:28.478153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:28.478879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:28.479332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:28.479760 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:28.616268 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:28.623837 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2575ef45-9e50-4fd8-b689-bca80d3a357b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.158511 Oct 23 02:23:28.624410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 574/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:28 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:29.648557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:29.649246 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:29.655557 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:29.655971 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:29.656397 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:29.657071 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:29.657516 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:29.657933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:29.789235 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:29.796753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-05973e76-9660-439b-8553-9af23dce2403 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.152902 Oct 23 02:23:29.797307 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 569/1143] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:29 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:30.821001 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:30.821542 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:30.827899 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:30.828379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:30.828810 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:30.829498 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:30.829949 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:30.830372 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:30.962987 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:30.970753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-eb05fdc8-f5e3-4697-a82a-c42f51c68d8b tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.154278 Oct 23 02:23:30.971323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 575/1144] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:30 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:31.993735 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:31.994346 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:32.000956 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:32.001437 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:32.001866 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:32.002576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:32.003021 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:32.003438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:32.321160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:32.328758 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-4a46cd71-163f-4c44-bd19-a71dc41317b5 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.339120 Oct 23 02:23:32.329323 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 570/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:31 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:33.352923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:33.353648 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:33.360459 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:33.360942 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:33.361376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:33.362100 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:33.362587 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:33.363079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:33.499182 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:33.510127 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-922f8c97-ea83-4581-a1f7-de82d8628ba4 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.161674 Oct 23 02:23:33.510746 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 576/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:33 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:34.128960 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-0dcbea9f-7466-4b22-a1d3-4bb2251229d8 req-c51f9cb4-ed54-4d91-b4a0-dc6c98d51294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9998bce-326b-428b-918a-98a6687d70df", "name": "network-vif-plugged", "status": "completed", "tag": "ef16eb1f-55cf-490d-b282-8bfea6551a1b"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:34.139014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0dcbea9f-7466-4b22-a1d3-4bb2251229d8 req-c51f9cb4-ed54-4d91-b4a0-dc6c98d51294 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:34.139484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0dcbea9f-7466-4b22-a1d3-4bb2251229d8 req-c51f9cb4-ed54-4d91-b4a0-dc6c98d51294 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:34.139910 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0dcbea9f-7466-4b22-a1d3-4bb2251229d8 req-c51f9cb4-ed54-4d91-b4a0-dc6c98d51294 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:34.151610 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-0dcbea9f-7466-4b22-a1d3-4bb2251229d8 req-c51f9cb4-ed54-4d91-b4a0-dc6c98d51294 service nova] Creating event network-vif-plugged:ef16eb1f-55cf-490d-b282-8bfea6551a1b for instance d9998bce-326b-428b-918a-98a6687d70df on hv-cinder-86149 Oct 23 02:23:34.156508 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-0dcbea9f-7466-4b22-a1d3-4bb2251229d8 req-c51f9cb4-ed54-4d91-b4a0-dc6c98d51294 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158663 Oct 23 02:23:34.157080 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 571/1147] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:34.533635 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:34.534243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:34.541151 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:34.541625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:34.542051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:34.542753 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:34.543199 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:34.543618 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:34.672196 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:34.680749 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-459bd296-db8e-479a-acde-08ed42763702 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.150923 Oct 23 02:23:34.681485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 577/1148] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:34 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:35.699688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:35.700448 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=6 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:35.704867 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:35.705551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:35.713132 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:35.713602 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:35.714056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:35.714753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:35.715199 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:35.715613 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:35.843381 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:35.851879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-13d89f2b-6fe3-4ce3-8a13-d13a5313102f tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.153163 Oct 23 02:23:35.852431 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 572/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:35 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:36.875006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:36.875627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:36.877517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:36.883469 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:36.883954 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:36.884390 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:36.885080 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:36.885532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:36.885958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:37.015410 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:37.023427 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8a0ac400-834e-421e-a0e2-626db85b81ea tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1315 microversion: 2.1 time: 0.152216 Oct 23 02:23:37.024010 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 578/1150] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:36 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:37.362207 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:37.362761 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:37.369109 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:37.369589 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:37.370027 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:37.370755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:37.371208 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:37.371633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:37.394299 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5edd7cfe-5262-4698-af27-a8a01235116b tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/ips" status: 200 len: 150 microversion: 2.1 time: 0.165442 Oct 23 02:23:37.395130 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 573/1151] 10.222.0.23 () {58 vars in 1248 bytes} [Sun Oct 23 02:23:37 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/ips => generated 150 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:38.047900 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:38.049205 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:38.055822 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:38.057026 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:38.057751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:38.058484 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:38.058947 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:38.059379 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:38.434781 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:38.442427 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-f68a258f-e212-474c-88bd-d3bf276cf32e tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1464 microversion: 2.1 time: 0.398592 Oct 23 02:23:38.443017 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 579/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:38 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1464 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:38.488725 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:38.489219 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:38.495990 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:38.496468 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:38.496896 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:38.497574 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:38.498023 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:38.498470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:38.524064 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Going to try to terminate instance {{(pid=118877) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:23:38.597244 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ca52c6ca-0610-43c4-bc27-481d7c4705a6 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 204 len: 0 microversion: 2.1 time: 0.112008 Oct 23 02:23:38.597855 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 574/1153] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:23:38 2022] DELETE /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:23:38.607863 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:38.608481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:38.614435 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:38.614945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:38.615377 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:38.616060 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:38.616507 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:38.616926 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:38.748481 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:38.756061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fd964054-c50c-4a6c-a533-b04ec7d16a7a tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1470 microversion: 2.1 time: 0.153683 Oct 23 02:23:38.756626 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 580/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:38 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:39.781065 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:39.781765 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:39.786886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0430c3cb-8bda-412c-b695-9b5c2dae0620"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:39.788119 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:39.788596 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:39.789024 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:39.789261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:39.789704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:39.790147 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:39.790593 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:39.795622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:39.796105 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:39.796544 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:39.797234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:39.797689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:39.798116 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:39.924892 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:39.932708 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a4ef4bc1-b0a8-4f85-a9d0-b0b08bb8bae1 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1470 microversion: 2.1 time: 0.155866 Oct 23 02:23:39.933263 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 575/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:39 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:40.148257 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bd1f6b1f-c5b1-4510-b02e-d8cad383ac3d tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "POST /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365167 Oct 23 02:23:40.148860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 581/1156] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:23:39 2022] POST /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:23:40.956112 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:40.956711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:40.963073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:40.964056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:40.964764 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:40.965264 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:40.965718 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:40.966139 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:41.177285 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52a62b82d2514ec785e69c61b069bff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432641cf60c943ac810f1c55defbf4e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:41.185079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-145bc1f2-b7ba-49a5-82e7-1c47357cf865 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 200 len: 1470 microversion: 2.1 time: 0.232857 Oct 23 02:23:41.185660 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 576/1157] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:40 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 1470 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:41.288430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-90760334-107f-4b9a-b73d-0362f4a6b439 req-7ee7766a-57b3-4b53-b976-5333a6dca8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9998bce-326b-428b-918a-98a6687d70df", "name": "network-vif-deleted", "tag": "ef16eb1f-55cf-490d-b282-8bfea6551a1b"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:41.300062 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-90760334-107f-4b9a-b73d-0362f4a6b439 req-7ee7766a-57b3-4b53-b976-5333a6dca8be service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:41.300761 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-90760334-107f-4b9a-b73d-0362f4a6b439 req-7ee7766a-57b3-4b53-b976-5333a6dca8be service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:41.301194 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-90760334-107f-4b9a-b73d-0362f4a6b439 req-7ee7766a-57b3-4b53-b976-5333a6dca8be service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:41.314748 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-90760334-107f-4b9a-b73d-0362f4a6b439 req-7ee7766a-57b3-4b53-b976-5333a6dca8be service nova] Creating event network-vif-deleted:ef16eb1f-55cf-490d-b282-8bfea6551a1b for instance d9998bce-326b-428b-918a-98a6687d70df on hv-cinder-86149 Oct 23 02:23:41.321049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-90760334-107f-4b9a-b73d-0362f4a6b439 req-7ee7766a-57b3-4b53-b976-5333a6dca8be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040701 Oct 23 02:23:41.321662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 582/1158] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:42.209156 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:42.209771 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] [instance: d9998bce-326b-428b-918a-98a6687d70df] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:42.217020 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:42.217494 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:42.217923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:42.218629 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:42.219078 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:42.219494 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:42.235373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] HTTP exception thrown: Instance d9998bce-326b-428b-918a-98a6687d70df could not be found. Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Request method failure captured: Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df HTTP/1.1 Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKWaLacTxjis0lqTMR8iMbt33bhi-w6r8YcxxJMeLdKp5sDDXRMgZZbYhRKdbNCCGcYkvCzOE5NHNy6h8trOe3sOtyfqEAWYa3Sg6vkMy7jXwmyAGoGHfENk33FnD8KZLgG3AtaLqQuLrzCcMR5eL6PX-WCFbhScLsESwyC3xg-mlF4 Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 432641cf60c943ac810f1c55defbf4e0 Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesNegativeTest-857960468 Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:23:42.237565 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/432641cf60c943ac810f1c55defbf4e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/432641cf60c943ac810f1c55defbf4e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_432641cf60c943ac810f1c55defbf4e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/432641cf60c943ac810f1c55defbf4e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesNegativeTest-857960468 Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 432641cf60c943ac810f1c55defbf4e0 Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesNegativeTest-857960468 Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesNegativeTest-857960468-project Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 52a62b82d2514ec785e69c61b069bff8 Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesNegativeTest-857960468-project Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance d9998bce-326b-428b-918a-98a6687d70df could not be found. Oct 23 02:23:42.239047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'd9998bce-326b-428b-918a-98a6687d70df'} Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9998bce-326b-428b-918a-98a6687d70df could not be found. Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:23:42.239974 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9998bce-326b-428b-918a-98a6687d70df could not be found. Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9998bce-326b-428b-918a-98a6687d70df could not be found. Oct 23 02:23:42.241510 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:23:42.242716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] Returning 404 to user: Instance d9998bce-326b-428b-918a-98a6687d70df could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:23:42.242716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-78e84fb6-54c8-4c10-93be-8c41e887d071 tempest-VolumesNegativeTest-857960468 tempest-VolumesNegativeTest-857960468-project] 10.222.0.23 "GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df" status: 404 len: 111 microversion: 2.1 time: 0.033170 Oct 23 02:23:42.242716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 577/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:42 2022] GET /compute/v2.1/servers/d9998bce-326b-428b-918a-98a6687d70df => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:23:52.492108 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-946522446"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:52.493159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:52.496009 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=24 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:52.496747 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:52.505251 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:52.505790 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:52.506470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:52.507179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:52.507627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:52.508176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:52.655234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.network.security_group_api [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Removing security group 95f8d794-a1e7-4e95-84b8-39967694c309 from port 462339c3-99e2-4be4-ad61-d3a034c848c3 Oct 23 02:23:53.031187 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bd841135-747b-4d7d-a11f-cd58d508ff8f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "POST /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/action" status: 202 len: 0 microversion: 2.1 time: 0.545269 Oct 23 02:23:53.041264 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 583/1160] 10.222.0.23 () {60 vars in 1278 bytes} [Sun Oct 23 02:23:52 2022] POST /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:23:53.043554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-f360a437-1b46-4798-95a6-73c30d76a29b req-cae77467-fdba-49e6-99e7-3d88a1027267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df94ed8c-7abe-49c1-b835-b2a8fd4e2c43", "tag": "462339c3-99e2-4be4-ad61-d3a034c848c3"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:53.055476 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:53.056188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:23:53.059013 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f360a437-1b46-4798-95a6-73c30d76a29b req-cae77467-fdba-49e6-99e7-3d88a1027267 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:53.059991 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f360a437-1b46-4798-95a6-73c30d76a29b req-cae77467-fdba-49e6-99e7-3d88a1027267 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:53.060705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f360a437-1b46-4798-95a6-73c30d76a29b req-cae77467-fdba-49e6-99e7-3d88a1027267 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:53.077528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-f360a437-1b46-4798-95a6-73c30d76a29b req-cae77467-fdba-49e6-99e7-3d88a1027267 service nova] Creating event network-changed:462339c3-99e2-4be4-ad61-d3a034c848c3 for instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 on hv-cinder-86149 Oct 23 02:23:53.084251 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-f360a437-1b46-4798-95a6-73c30d76a29b req-cae77467-fdba-49e6-99e7-3d88a1027267 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047332 Oct 23 02:23:53.085313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 578/1161] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:54.193226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:54.193783 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:54.199496 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:54.199985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:54.200430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:54.201131 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:54.201584 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:54.202013 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:54.283731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lazy-loading 'services' on Instance uuid df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:23:54.356107 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-74fbc74d-d176-4ca3-a7ec-794ce1aa66d3 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments/977ea5df-e4b3-404b-bcc2-1ae3220e0978" status: 202 len: 0 microversion: 2.1 time: 0.167734 Oct 23 02:23:54.356804 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 584/1162] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:23:54 2022] DELETE /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments/977ea5df-e4b3-404b-bcc2-1ae3220e0978 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:23:54.367748 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:54.370163 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:54.378113 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:54.378653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:54.379090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:54.379906 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:54.380364 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:54.380788 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:54.410744 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e635cc06-a086-4e5a-935a-4f52ee725d6b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048192 Oct 23 02:23:54.411311 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 579/1163] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:23:54 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:55.100894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-2b559c08-31a2-4f93-9a4b-ab7f0d2e7d37 req-96cb49ae-a4cc-459c-a410-8ce73def135a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df94ed8c-7abe-49c1-b835-b2a8fd4e2c43", "tag": "462339c3-99e2-4be4-ad61-d3a034c848c3"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:55.114145 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-2b559c08-31a2-4f93-9a4b-ab7f0d2e7d37 req-96cb49ae-a4cc-459c-a410-8ce73def135a service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:55.114986 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-2b559c08-31a2-4f93-9a4b-ab7f0d2e7d37 req-96cb49ae-a4cc-459c-a410-8ce73def135a service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:55.115418 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-2b559c08-31a2-4f93-9a4b-ab7f0d2e7d37 req-96cb49ae-a4cc-459c-a410-8ce73def135a service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:55.129956 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-2b559c08-31a2-4f93-9a4b-ab7f0d2e7d37 req-96cb49ae-a4cc-459c-a410-8ce73def135a service nova] Creating event network-changed:462339c3-99e2-4be4-ad61-d3a034c848c3 for instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 on hv-cinder-86149 Oct 23 02:23:55.134959 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-2b559c08-31a2-4f93-9a4b-ab7f0d2e7d37 req-96cb49ae-a4cc-459c-a410-8ce73def135a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037951 Oct 23 02:23:55.138556 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 585/1164] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:55.424810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:55.426984 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:55.433791 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:55.434278 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:55.434795 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:55.435474 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:55.435963 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:55.436433 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:55.467696 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d681526b-bc16-45f3-b2dd-d7f34c572be7 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047727 Oct 23 02:23:55.468272 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 580/1165] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:23:55 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:56.481584 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:56.483820 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:56.490482 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:56.490993 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:56.491429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:56.492110 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:56.492558 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:56.492979 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:56.522315 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cc243780-b4d7-47a9-92d8-87ff60e0372b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Oct 23 02:23:56.522894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 586/1166] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:23:56 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:57.534684 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:57.537801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:57.544734 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:57.545227 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:57.545657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:57.546339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:57.546996 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:57.547416 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:57.578432 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-181ef0c3-9508-414f-b7f1-6e52ae2a869b tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048239 Oct 23 02:23:57.579137 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 581/1167] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:23:57 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:57.947601 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:57.948144 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:57.951473 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-f8ed455b-4838-4734-8203-3ec72ea81962 req-a3551deb-ba41-4d0e-a24d-dbe4dcf2782f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa5faf5-5722-40fd-b4aa-c8a419e8c73d", "tag": "6ebd6dec-ed9e-49f3-9f6a-d935781e2f04"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:23:57.954741 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:57.955754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:57.956198 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:57.956901 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:57.957369 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:57.957787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:57.962869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f8ed455b-4838-4734-8203-3ec72ea81962 req-a3551deb-ba41-4d0e-a24d-dbe4dcf2782f service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:57.963347 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f8ed455b-4838-4734-8203-3ec72ea81962 req-a3551deb-ba41-4d0e-a24d-dbe4dcf2782f service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:57.963772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-f8ed455b-4838-4734-8203-3ec72ea81962 req-a3551deb-ba41-4d0e-a24d-dbe4dcf2782f service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:57.977053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-f8ed455b-4838-4734-8203-3ec72ea81962 req-a3551deb-ba41-4d0e-a24d-dbe4dcf2782f service nova] Creating event network-changed:6ebd6dec-ed9e-49f3-9f6a-d935781e2f04 for instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d on hv-cinder-86149 Oct 23 02:23:57.982345 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-f8ed455b-4838-4734-8203-3ec72ea81962 req-a3551deb-ba41-4d0e-a24d-dbe4dcf2782f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036708 Oct 23 02:23:57.983371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 582/1168] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:23:57.988172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:23:58.063788 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c9109f65-3c82-4b0b-a21e-d5886b8d7ce7 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 204 len: 0 microversion: 2.1 time: 0.119759 Oct 23 02:23:58.064866 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 587/1169] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:23:57 2022] DELETE /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:23:58.075019 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:58.075711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:58.083435 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:58.083916 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:58.084349 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:58.085036 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:58.085821 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:58.085953 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:58.561688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:58.562407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:58.571991 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:58.572482 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:58.573403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:58.576457 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:58.577185 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:58.577643 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:58.578072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:58.583419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-144602d8-a4f6-4f60-b03d-80d99e9ef991 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1577 microversion: 2.1 time: 0.512787 Oct 23 02:23:58.584508 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 583/1170] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:58 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1577 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:23:58.604016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:58.606872 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:58.613666 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:58.614480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:58.615154 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:58.616357 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:58.617012 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:58.617650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:58.650007 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5cb3e734-824a-427c-b280-8c4a4485e1e0 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050520 Oct 23 02:23:58.650797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 584/1171] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:23:58 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:58.678354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lazy-loading 'services' on Instance uuid f4456352-a66e-455c-bbec-3e8ea1a334ec {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:23:58.756084 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-6f3cf1d1-4c88-42c2-8572-57fd75473fe1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments/0430c3cb-8bda-412c-b695-9b5c2dae0620" status: 202 len: 0 microversion: 2.1 time: 0.198565 Oct 23 02:23:58.759391 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 588/1172] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:23:58 2022] DELETE /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments/0430c3cb-8bda-412c-b695-9b5c2dae0620 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:23:58.765075 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:58.767498 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:58.773495 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:58.773981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:58.774420 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:58.775194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:58.775698 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:58.776126 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:58.809454 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-0c680ba4-75b3-4ec7-a564-1b551b0ab0b5 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048320 Oct 23 02:23:58.810036 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 585/1173] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:23:58 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:59.612733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:59.613430 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:59.619989 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:59.620465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:59.620898 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:59.621588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:59.622031 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:59.622470 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:59.665407 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:59.669653 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:59.677612 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:59.678579 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:59.679341 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:59.680634 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:59.681362 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:59.681949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:59.724485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2c9def7b-ac31-42af-80f4-a781c8efc512 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064308 Oct 23 02:23:59.729888 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 586/1174] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:23:59 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:23:59.823194 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:23:59.826993 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:23:59.834776 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:59.835260 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:59.835705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:59.835892 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:23:59.836441 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:23:59.837069 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:23:59.837517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:23:59.854923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-14396469-1d09-4aff-8a07-8f549af1bc23 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1577 microversion: 2.1 time: 0.246434 Oct 23 02:23:59.855523 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 589/1175] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:23:59 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1577 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:23:59.868857 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2675dcb7-3efe-4c8b-9c23-bc0c050c7dc8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049758 Oct 23 02:23:59.869412 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 587/1176] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:23:59 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:24:00.738691 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:00.741499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:00.747743 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:00.748255 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:00.748688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:00.749564 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:00.750008 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:00.750465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:00.786384 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3021544a-03f9-4394-be11-147825dde92a tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052832 Oct 23 02:24:00.787378 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 590/1177] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:00 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:24:00.797501 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:00.797998 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:00.805808 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:00.806585 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:00.807202 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:00.808070 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:00.808621 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:00.809060 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:00.880403 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:00.881355 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:00.887659 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:00.888399 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:00.888993 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:00.889851 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:00.890472 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:00.891214 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:00.905196 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] HTTP exception thrown: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 is not attached to volume 977ea5df-e4b3-404b-bcc2-1ae3220e0978 Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Request method failure captured: Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments/977ea5df-e4b3-404b-bcc2-1ae3220e0978 HTTP/1.1 Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKSiQqVYQa27IMvd4XbmLxSBkseD0alSJXf3mzzi5qmvq_48pKz6R0yfmy3qDBVeirIzdzoMtplleGFq2NbxksZ5N0geUI3xzzMCpKkeBwODY5tuOPJqc2bvG673aWsJYgFqa3D9Bwx3xPcyJYBLZCqYEhQn4-IHySrUIwiGCoITH54 Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 7d85fefc9f0b47f8bad45fb6dd0810f9 Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-TestMinimumBasicScenario-733554728 Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:24:00.914270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d85fefc9f0b47f8bad45fb6dd0810f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d85fefc9f0b47f8bad45fb6dd0810f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7d85fefc9f0b47f8bad45fb6dd0810f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7d85fefc9f0b47f8bad45fb6dd0810f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-TestMinimumBasicScenario-733554728 Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 7d85fefc9f0b47f8bad45fb6dd0810f9 Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-TestMinimumBasicScenario-733554728 Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-TestMinimumBasicScenario-733554728-project Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 7a3de8194ccd4eec9c19a6b250944457 Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-TestMinimumBasicScenario-733554728-project Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:24:00.916011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 is not attached to volume 977ea5df-e4b3-404b-bcc2-1ae3220e0978 Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'server_id': 'df94ed8c-7abe-49c1-b835-b2a8fd4e2c43', 'id': '977ea5df-e4b3-404b-bcc2-1ae3220e0978'} Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 977ea5df-e4b3-404b-bcc2-1ae3220e0978. Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:00.916921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 is not attached to volume 977ea5df-e4b3-404b-bcc2-1ae3220e0978 Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 is not attached to volume 977ea5df-e4b3-404b-bcc2-1ae3220e0978 Oct 23 02:24:00.918365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:00.920804 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Returning 404 to user: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 is not attached to volume 977ea5df-e4b3-404b-bcc2-1ae3220e0978 {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:00.922082 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1b64e633-eb3e-4158-8140-fb44027ad389 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments/977ea5df-e4b3-404b-bcc2-1ae3220e0978" status: 404 len: 154 microversion: 2.1 time: 0.128618 Oct 23 02:24:00.926790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 588/1178] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:24:00 2022] DELETE /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43/os-volume_attachments/977ea5df-e4b3-404b-bcc2-1ae3220e0978 => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:00.932979 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:00.937261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:00.944187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:00.945011 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:00.945664 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:00.946618 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:00.947279 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:00.947982 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:00.982774 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-ee35830c-3fdb-4f8b-ac8f-93bed80e45d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054593 Oct 23 02:24:00.983841 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 589/1179] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:00 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:01.313829 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:01.322412 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5accc877-1ac1-4cea-af80-f6baf0fdb001 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1577 microversion: 2.1 time: 0.447625 Oct 23 02:24:01.323028 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 591/1180] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:00 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1577 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:01.750145 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-020e48ef-d05d-4e8a-b87b-cdf961838e28 req-4fd8620d-82f9-43bb-be50-03c3d77d88fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa5faf5-5722-40fd-b4aa-c8a419e8c73d", "name": "network-vif-deleted", "tag": "6ebd6dec-ed9e-49f3-9f6a-d935781e2f04"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:01.760029 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-020e48ef-d05d-4e8a-b87b-cdf961838e28 req-4fd8620d-82f9-43bb-be50-03c3d77d88fd service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:01.760497 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-020e48ef-d05d-4e8a-b87b-cdf961838e28 req-4fd8620d-82f9-43bb-be50-03c3d77d88fd service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:01.760918 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-020e48ef-d05d-4e8a-b87b-cdf961838e28 req-4fd8620d-82f9-43bb-be50-03c3d77d88fd service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:01.772437 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-020e48ef-d05d-4e8a-b87b-cdf961838e28 req-4fd8620d-82f9-43bb-be50-03c3d77d88fd service nova] Creating event network-vif-deleted:6ebd6dec-ed9e-49f3-9f6a-d935781e2f04 for instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d on hv-cinder-86149 Oct 23 02:24:01.777018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-020e48ef-d05d-4e8a-b87b-cdf961838e28 req-4fd8620d-82f9-43bb-be50-03c3d77d88fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.253728 Oct 23 02:24:01.777910 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 590/1181] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:01.998139 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:02.000337 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:02.009177 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.009662 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.010096 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.010937 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.011294 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.011713 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.044703 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-cf9bec5e-afe3-4d1c-aad2-16bf01ea77df tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051779 Oct 23 02:24:02.045270 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 592/1182] 10.222.0.23 () {58 vars in 1302 bytes} [Sun Oct 23 02:24:01 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 23 02:24:02.119223 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:02.119806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:02.126391 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.126928 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.128645 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.129430 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.135701 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:02.136201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:02.139665 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.140102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.142613 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.143173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.144341 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.145375 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.145920 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.146419 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.173388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:24:02.174234 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Going to try to terminate instance {{(pid=118877) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:24:02.267747 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8a7a9091-775d-4175-8ff2-11372471ee6f tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 204 len: 0 microversion: 2.1 time: 0.154474 Oct 23 02:24:02.268414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 591/1183] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:24:02 2022] DELETE /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:24:02.275317 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-665997ec-5e7f-43bc-a5d3-ddbf7c60179c tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 204 len: 0 microversion: 2.1 time: 0.143854 Oct 23 02:24:02.276006 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 593/1184] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:24:02 2022] DELETE /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:24:02.279440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:02.279440 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:02.287322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.287322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.287322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.287322 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.287688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:02.287789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.287789 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.287960 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:02.294639 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.295545 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.296091 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.297034 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.297585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.298213 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.496691 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:02.506236 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a8d95a69-e089-4756-82a9-54588a48e79c tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1554 microversion: 2.1 time: 0.233266 Oct 23 02:24:02.507162 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 592/1185] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:02 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:24:02.508424 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:02.512603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:02.514084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:02.518635 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0640a937-26d6-49d2-812a-eab7ca3abbea tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1682 microversion: 2.1 time: 0.237117 Oct 23 02:24:02.520796 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 594/1186] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:02 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1682 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:24:02.522945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.523446 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.523949 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.524762 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.525281 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.525834 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.561239 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:02.561724 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:02.562164 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:02.562640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lazy-loading 'fault' on Instance uuid daa5faf5-5722-40fd-b4aa-c8a419e8c73d {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:24:02.606598 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:02.615314 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-229c0d9e-c680-4557-8153-b5351fe324a5 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1231 microversion: 2.1 time: 0.106823 Oct 23 02:24:02.615910 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 593/1187] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:02 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:03.529365 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:03.530012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:03.537770 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:03.538260 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:03.538744 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:03.539445 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:03.539903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:03.540331 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:03.546042 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:03.546690 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:03.554644 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:03.555218 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:03.555742 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:03.556646 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:03.560484 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:03.560932 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:03.582239 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:03.757766 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:03.760930 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:03.762327 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:03.768592 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d3a3bb31-fcb6-489e-8b7c-e647fa5dd78d tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1554 microversion: 2.1 time: 0.243343 Oct 23 02:24:03.769630 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-2cd93fdf-dcaa-4994-a298-a979027eeb41 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1682 microversion: 2.1 time: 0.226738 Oct 23 02:24:03.770149 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 595/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:03 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:03.770577 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 594/1189] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:03 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:24:03.776204 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:03.776819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:03.783935 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:03.784423 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:03.785433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:03.786578 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:03.787043 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:03.787474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:03.818819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:03.819397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:03.819829 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:03.820281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lazy-loading 'fault' on Instance uuid daa5faf5-5722-40fd-b4aa-c8a419e8c73d {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:24:03.861776 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:03.870012 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-75f4c636-3d19-4e10-97d5-295d55bfac5d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1231 microversion: 2.1 time: 0.098513 Oct 23 02:24:03.870608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 596/1190] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:03 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:04.793623 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:04.794235 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:04.796552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:04.797171 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:04.801642 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:04.802256 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:04.802688 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:04.803379 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:04.803831 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:04.804018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:04.804257 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:04.804499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:04.804945 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:04.805621 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:04.806086 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:04.806533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:04.999113 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:05.002223 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:05.006887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-afd7ce75-a26a-4d27-ac59-23e6d1e1e3b4 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1554 microversion: 2.1 time: 0.214164 Oct 23 02:24:05.007543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 597/1191] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:04 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:24:05.012104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:05.012790 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:05.013031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1ca8fb56-78a9-42bf-85e1-2eaac0e897c4 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1682 microversion: 2.1 time: 0.223128 Oct 23 02:24:05.013810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 595/1192] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:04 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:05.018773 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:05.019429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:05.020033 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:05.020727 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:05.021175 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:05.021597 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:05.052135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:05.052604 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:05.053093 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:05.053531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lazy-loading 'fault' on Instance uuid daa5faf5-5722-40fd-b4aa-c8a419e8c73d {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:24:05.096570 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:05.104126 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-449f2a5b-8bb7-4ab2-86a0-9a3dc1daa95c tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 200 len: 1231 microversion: 2.1 time: 0.095592 Oct 23 02:24:05.104696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 598/1193] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:05 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:06.031337 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:06.037755 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:06.038376 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:06.042294 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:06.050655 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:06.051201 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:06.051640 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:06.052532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:06.052982 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:06.053409 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:06.055689 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:06.056016 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:06.056638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:06.057331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:06.057900 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:06.058195 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:06.227325 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:06.238207 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9414de6a-8a23-4da5-bd03-fdf3cf7fe959 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1614 microversion: 2.1 time: 0.205074 Oct 23 02:24:06.241805 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 599/1194] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:06 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1614 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:06.250925 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:06.251552 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: daa5faf5-5722-40fd-b4aa-c8a419e8c73d] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:06.265896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:06.266400 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:06.266886 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:06.267601 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:06.268110 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:06.268543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:06.285158 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] HTTP exception thrown: Instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d could not be found. Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Request method failure captured: Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d HTTP/1.1 Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKNDHKikYXu23VSMbM8Uv3FK0IPJ8BV-XvHTQkhR-gU_ntrUIDSLgSDf4VbyaB0csCGtTcWi2whWptTEyq1CsbMUxtfeUzpAsKSmbrwY6t309FI7ZFfH267GACBGXuM3hQIom1pyEQexspKc8Ns4k5SvhUV8XW97_J-w6G9mMSb4NPw Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:24:06.287557 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: d8cd3210dbea46d6912c93c6d28356ae Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d could not be found. Oct 23 02:24:06.289153 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'daa5faf5-5722-40fd-b4aa-c8a419e8c73d'} Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d could not be found. Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:06.290172 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d could not be found. Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d could not be found. Oct 23 02:24:06.291680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:06.293290 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Returning 404 to user: Instance daa5faf5-5722-40fd-b4aa-c8a419e8c73d could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:06.294296 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c7b40039-72a0-479a-8e7d-2c067c933ae8 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d" status: 404 len: 111 microversion: 2.1 time: 0.051363 Oct 23 02:24:06.298209 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 600/1195] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:06 2022] GET /compute/v2.1/servers/daa5faf5-5722-40fd-b4aa-c8a419e8c73d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:06.349025 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:06.357720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-cd3d80f4-0582-4a8f-8a00-2e373f5198b5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1554 microversion: 2.1 time: 0.330344 Oct 23 02:24:06.369260 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 596/1196] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:06 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1554 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:06.596200 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-3c51c2ae-88e7-4ae1-ab79-64b79236a07f req-fdbe43cb-de48-4ad1-bc3c-75b434a9c43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4456352-a66e-455c-bbec-3e8ea1a334ec", "name": "network-vif-deleted", "tag": "74f1daea-22d2-425b-9fe5-f40d95839a20"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:06.622245 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-3c51c2ae-88e7-4ae1-ab79-64b79236a07f req-fdbe43cb-de48-4ad1-bc3c-75b434a9c43a service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:06.623346 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-3c51c2ae-88e7-4ae1-ab79-64b79236a07f req-fdbe43cb-de48-4ad1-bc3c-75b434a9c43a service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:06.624038 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-3c51c2ae-88e7-4ae1-ab79-64b79236a07f req-fdbe43cb-de48-4ad1-bc3c-75b434a9c43a service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:06.664388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-3c51c2ae-88e7-4ae1-ab79-64b79236a07f req-fdbe43cb-de48-4ad1-bc3c-75b434a9c43a service nova] Creating event network-vif-deleted:74f1daea-22d2-425b-9fe5-f40d95839a20 for instance f4456352-a66e-455c-bbec-3e8ea1a334ec on hv-cinder-86149 Oct 23 02:24:06.670993 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-e9aa6b3a-a1cc-4669-92b3-031e6a448ea9 req-6399db8b-8893-41e5-afe5-f8c08f818130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df94ed8c-7abe-49c1-b835-b2a8fd4e2c43", "name": "network-vif-deleted", "tag": "462339c3-99e2-4be4-ad61-d3a034c848c3"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:06.674507 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-3c51c2ae-88e7-4ae1-ab79-64b79236a07f req-fdbe43cb-de48-4ad1-bc3c-75b434a9c43a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082798 Oct 23 02:24:06.679059 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 601/1197] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:06.687366 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-e9aa6b3a-a1cc-4669-92b3-031e6a448ea9 req-6399db8b-8893-41e5-afe5-f8c08f818130 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:06.688154 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-e9aa6b3a-a1cc-4669-92b3-031e6a448ea9 req-6399db8b-8893-41e5-afe5-f8c08f818130 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:06.688829 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-e9aa6b3a-a1cc-4669-92b3-031e6a448ea9 req-6399db8b-8893-41e5-afe5-f8c08f818130 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:06.704546 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-e9aa6b3a-a1cc-4669-92b3-031e6a448ea9 req-6399db8b-8893-41e5-afe5-f8c08f818130 service nova] Creating event network-vif-deleted:462339c3-99e2-4be4-ad61-d3a034c848c3 for instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 on hv-cinder-86149 Oct 23 02:24:06.716898 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-e9aa6b3a-a1cc-4669-92b3-031e6a448ea9 req-6399db8b-8893-41e5-afe5-f8c08f818130 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049844 Oct 23 02:24:06.719600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 597/1198] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:07.276928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:07.287073 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:07.298484 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:07.302712 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:07.305323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:07.307494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:07.309246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:07.310025 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:07.363371 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:07.364879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:07.365972 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:07.366627 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lazy-loading 'fault' on Instance uuid f4456352-a66e-455c-bbec-3e8ea1a334ec {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:24:07.383773 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:07.385238 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:07.399980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:07.403050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:07.403882 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:07.405048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:07.406720 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:07.408897 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:07.432168 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66975cf6d8fa417e8df429d4c89ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab81e47f8d6426fbd5b50d1eb7fc14a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:07.439958 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d68a9089-6d83-47c5-bb54-834017dc34b0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 200 len: 1331 microversion: 2.1 time: 0.173518 Oct 23 02:24:07.440532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 602/1199] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:07 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 1331 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:07.464638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:07.465136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:07.465850 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:07.466695 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lazy-loading 'fault' on Instance uuid df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:24:07.525309 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a3de8194ccd4eec9c19a6b250944457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d85fefc9f0b47f8bad45fb6dd0810f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:07.534942 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5f695268-e108-4f6c-a85a-93bf3497ecdc tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 200 len: 1348 microversion: 2.1 time: 0.155402 Oct 23 02:24:07.535528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 598/1200] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:07 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 1348 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:08.466799 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:08.467417 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:08.474354 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:08.474893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:08.475329 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:08.476047 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:08.476499 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:08.476921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:08.490179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec HTTP/1.1 Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:24:08.491847 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:08.493494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'f4456352-a66e-455c-bbec-3e8ea1a334ec'} Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:08.494676 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:08.496183 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.497629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:08.497629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fbbedebe-9791-4654-a9d5-830d8a3a8455 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 404 len: 111 microversion: 2.1 time: 0.030280 Oct 23 02:24:08.497629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 603/1201] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:08 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:08.501961 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b7b030ea-86f6-43d9-b232-9afad482e1c1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '.version_select at 0x7f9da2deaaf0>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:08.506948 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7b030ea-86f6-43d9-b232-9afad482e1c1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [f83d193f-9832-43df-9e11-a9bb45e3410d] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 23 02:24:08.559315 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:08.559934 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] [instance: df94ed8c-7abe-49c1-b835-b2a8fd4e2c43] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:08.565779 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:08.566266 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:08.566747 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:08.567940 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:08.568399 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:08.568829 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:08.581870 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] HTTP exception thrown: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 could not be found. Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Request method failure captured: Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 HTTP/1.1 Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKSiQqVYQa27IMvd4XbmLxSBkseD0alSJXf3mzzi5qmvq_48pKz6R0yfmy3qDBVeirIzdzoMtplleGFq2NbxksZ5N0geUI3xzzMCpKkeBwODY5tuOPJqc2bvG673aWsJYgFqa3D9Bwx3xPcyJYBLZCqYEhQn4-IHySrUIwiGCoITH54 Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: 7d85fefc9f0b47f8bad45fb6dd0810f9 Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-TestMinimumBasicScenario-733554728 Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:24:08.584109 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d85fefc9f0b47f8bad45fb6dd0810f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7d85fefc9f0b47f8bad45fb6dd0810f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7d85fefc9f0b47f8bad45fb6dd0810f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7d85fefc9f0b47f8bad45fb6dd0810f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-TestMinimumBasicScenario-733554728 Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: 7d85fefc9f0b47f8bad45fb6dd0810f9 Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-TestMinimumBasicScenario-733554728 Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-TestMinimumBasicScenario-733554728-project Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 7a3de8194ccd4eec9c19a6b250944457 Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-TestMinimumBasicScenario-733554728-project Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 could not be found. Oct 23 02:24:08.586582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'df94ed8c-7abe-49c1-b835-b2a8fd4e2c43'} Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 could not be found. Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:08.587968 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 could not be found. Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 could not be found. Oct 23 02:24:08.590491 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:08.592503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Returning 404 to user: Instance df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:08.592503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9e18b1c1-d182-45c4-91cf-70aaa45379c5 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43" status: 404 len: 111 microversion: 2.1 time: 0.030084 Oct 23 02:24:08.592503 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 604/1202] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:08 2022] GET /compute/v2.1/servers/df94ed8c-7abe-49c1-b835-b2a8fd4e2c43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:24:08.593475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-46cf981c-bebf-4ca7-abb2-d2a20cd83483 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] Calling method '.version_select at 0x7f9da3bf9550>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:08.612055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-46cf981c-bebf-4ca7-abb2-d2a20cd83483 tempest-TestMinimumBasicScenario-733554728 tempest-TestMinimumBasicScenario-733554728-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-170373157" status: 202 len: 0 microversion: 2.1 time: 0.021620 Oct 23 02:24:08.612456 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 605/1203] 10.222.0.23 () {58 vars in 1269 bytes} [Sun Oct 23 02:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-170373157 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:24:09.522333 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7b030ea-86f6-43d9-b232-9afad482e1c1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [f83d193f-9832-43df-9e11-a9bb45e3410d] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 40652. Oct 23 02:24:09.543591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b7b030ea-86f6-43d9-b232-9afad482e1c1 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217992674" status: 202 len: 0 microversion: 2.1 time: 1.045290 Oct 23 02:24:09.544921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 599/1204] 10.222.0.23 () {58 vars in 1221 bytes} [Sun Oct 23 02:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217992674 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:24:09.845931 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:09.846494 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:09.848480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-af6a2c26-b1f0-4709-886e-a06485718b17 req-c8623cab-ae00-487c-a804-a586fcd698b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd81b2ca-f9cb-4bc3-a344-a92633a5d73f", "tag": "444e7dad-cf05-44e1-b92d-e45dbabfd2fb"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:09.854277 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:09.854804 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:09.855437 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:09.856342 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:09.857603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:09.858751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:09.871043 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-af6a2c26-b1f0-4709-886e-a06485718b17 req-c8623cab-ae00-487c-a804-a586fcd698b4 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:09.873031 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-af6a2c26-b1f0-4709-886e-a06485718b17 req-c8623cab-ae00-487c-a804-a586fcd698b4 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:09.874525 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-af6a2c26-b1f0-4709-886e-a06485718b17 req-c8623cab-ae00-487c-a804-a586fcd698b4 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:09.886528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:24:09.888128 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-af6a2c26-b1f0-4709-886e-a06485718b17 req-c8623cab-ae00-487c-a804-a586fcd698b4 service nova] Creating event network-changed:444e7dad-cf05-44e1-b92d-e45dbabfd2fb for instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f on hv-cinder-86149 Oct 23 02:24:09.894464 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-af6a2c26-b1f0-4709-886e-a06485718b17 req-c8623cab-ae00-487c-a804-a586fcd698b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050702 Oct 23 02:24:09.898591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 600/1205] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:24:09.997585 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8fe933f0-274a-4670-97fb-47c19dd2a48b tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 204 len: 0 microversion: 2.1 time: 0.155635 Oct 23 02:24:09.998380 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 606/1206] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:24:09 2022] DELETE /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:24:10.007797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:10.008828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:10.015977 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:10.017881 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:10.019050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:10.020248 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:10.021561 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:10.022360 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:10.269229 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:10.284477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-23d8f30f-b04c-42f2-9fcc-fa75ff4c567e tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1577 microversion: 2.1 time: 0.278682 Oct 23 02:24:10.287527 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 601/1207] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:10 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1577 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:11.316772 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:11.317517 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:11.327883 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:11.328807 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:11.329444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:11.330582 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:11.331387 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:11.332121 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:11.565874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:11.579016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-95698ff7-c198-43ae-aa96-6aa058d2f671 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1577 microversion: 2.1 time: 0.268815 Oct 23 02:24:11.579813 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 607/1208] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:11 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1577 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:11.771108 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:11.772253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:11.779391 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:11.779876 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:11.780520 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:11.781465 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:11.781920 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:11.782342 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:11.798228 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec HTTP/1.1 Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:24:11.800763 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.802535 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'f4456352-a66e-455c-bbec-3e8ea1a334ec'} Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:11.804419 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.805859 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.808756 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:11.809824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a9f3068e-7304-47aa-bfa7-fe06798929a2 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 404 len: 111 microversion: 2.1 time: 0.042847 Oct 23 02:24:11.810983 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 602/1209] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:24:11 2022] DELETE /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:11.821102 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:11.821855 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: f4456352-a66e-455c-bbec-3e8ea1a334ec] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:11.829063 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:11.829731 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:11.830299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:11.831281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:11.831923 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:11.832588 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:11.848448 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec HTTP/1.1 Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:24:11.851007 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.852504 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'f4456352-a66e-455c-bbec-3e8ea1a334ec'} Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:11.853288 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. Oct 23 02:24:11.855236 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:11.856842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance f4456352-a66e-455c-bbec-3e8ea1a334ec could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:11.856842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8d702cec-f5a3-4c55-b98a-fccb140b5967 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec" status: 404 len: 111 microversion: 2.1 time: 0.037782 Oct 23 02:24:11.856842 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 608/1210] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:11 2022] GET /compute/v2.1/servers/f4456352-a66e-455c-bbec-3e8ea1a334ec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:11.942986 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-cfbae907-2fdf-4d58-9c15-75a06fa87986 req-1e90ad94-e0af-4117-b660-439818735d38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd81b2ca-f9cb-4bc3-a344-a92633a5d73f", "name": "network-vif-deleted", "tag": "444e7dad-cf05-44e1-b92d-e45dbabfd2fb"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:11.955161 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-cfbae907-2fdf-4d58-9c15-75a06fa87986 req-1e90ad94-e0af-4117-b660-439818735d38 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:11.956215 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-cfbae907-2fdf-4d58-9c15-75a06fa87986 req-1e90ad94-e0af-4117-b660-439818735d38 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:11.956879 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-cfbae907-2fdf-4d58-9c15-75a06fa87986 req-1e90ad94-e0af-4117-b660-439818735d38 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:11.972049 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-cfbae907-2fdf-4d58-9c15-75a06fa87986 req-1e90ad94-e0af-4117-b660-439818735d38 service nova] Creating event network-vif-deleted:444e7dad-cf05-44e1-b92d-e45dbabfd2fb for instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f on hv-cinder-86149 Oct 23 02:24:11.983404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-cfbae907-2fdf-4d58-9c15-75a06fa87986 req-1e90ad94-e0af-4117-b660-439818735d38 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044530 Oct 23 02:24:11.984952 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 603/1211] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:12.606132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:12.607652 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:12.616830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:12.618104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:12.618801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:12.619872 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:12.620532 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:12.621157 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:12.696039 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:12.697821 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:12.698278 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:12.699180 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.objects.instance [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lazy-loading 'fault' on Instance uuid bd81b2ca-f9cb-4bc3-a344-a92633a5d73f {{(pid=118878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:24:12.820438 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8cd3210dbea46d6912c93c6d28356ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f27676e78f475fa9734f3d6f541da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:12.835051 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2b76e610-33c8-458b-aed4-61cf754bcd71 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 200 len: 1185 microversion: 2.1 time: 0.233090 Oct 23 02:24:12.837439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 609/1212] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:12 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 1185 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:13.020168 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:13.020759 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:13.029370 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.029955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.030486 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.031450 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.032357 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.032843 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.052454 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 HTTP/1.1 Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:24:13.055461 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.057032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'feb9b7c7-7380-423a-b0c5-43e7d775e9e7'} Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:13.057822 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.059114 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.062118 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:13.063142 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-54f243ab-042e-4404-85f7-ed2c7f1534e0 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 404 len: 111 microversion: 2.1 time: 0.047779 Oct 23 02:24:13.063923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 604/1213] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:24:13 2022] DELETE /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:13.072832 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:13.073459 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: feb9b7c7-7380-423a-b0c5-43e7d775e9e7] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:13.079823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.080320 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.080957 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.081706 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.082165 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.082633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.102105 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 HTTP/1.1 Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:24:13.103928 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.105608 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'feb9b7c7-7380-423a-b0c5-43e7d775e9e7'} Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:13.106426 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. Oct 23 02:24:13.107985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.110176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance feb9b7c7-7380-423a-b0c5-43e7d775e9e7 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:13.111273 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-37b7fa9b-3192-4ddf-9986-e56019b8d9d8 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7" status: 404 len: 111 microversion: 2.1 time: 0.042997 Oct 23 02:24:13.111845 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 610/1214] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:13 2022] GET /compute/v2.1/servers/feb9b7c7-7380-423a-b0c5-43e7d775e9e7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:13.120615 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:13.121364 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:13.129117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.129704 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.130216 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.131096 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.132308 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.132805 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.148140 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: DELETE /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 HTTP/1.1 Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:24:13.149828 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.151470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '2bc846d9-9f7a-4a4a-a027-4117c043b0e5'} Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:13.152261 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.153544 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.154931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:13.154931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-406f708d-bdea-4211-afa7-c5385e01cb36 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 404 len: 111 microversion: 2.1 time: 0.034963 Oct 23 02:24:13.154931 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 605/1215] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:24:13 2022] DELETE /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:13.160714 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:13.161336 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: 2bc846d9-9f7a-4a4a-a027-4117c043b0e5] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:13.168629 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.169188 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.169746 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.170720 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.171285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.171819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.190474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 HTTP/1.1 Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:24:13.192939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.196733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': '2bc846d9-9f7a-4a4a-a027-4117c043b0e5'} Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:13.197529 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. Oct 23 02:24:13.198814 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.199927 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance 2bc846d9-9f7a-4a4a-a027-4117c043b0e5 could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:13.199927 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-515ea1d0-7bb4-4193-b0d5-b9c104b11e04 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5" status: 404 len: 111 microversion: 2.1 time: 0.038626 Oct 23 02:24:13.199927 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 611/1216] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:13 2022] GET /compute/v2.1/servers/2bc846d9-9f7a-4a4a-a027-4117c043b0e5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:13.867026 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:13.868028 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: bd81b2ca-f9cb-4bc3-a344-a92633a5d73f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:13.879731 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.887141 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.887751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.890243 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:13.891343 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:13.899656 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:13.934640 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] HTTP exception thrown: Instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f could not be found. Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Request method failure captured: Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f HTTP/1.1 Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKNDHKikYXu23VSMbM8Uv3FK0IPJ8BV-XvHTQkhR-gU_ntrUIDSLgSDf4VbyaB0csCGtTcWi2whWptTEyq1CsbMUxtfeUzpAsKSmbrwY6t309FI7ZFfH267GACBGXuM3hQIom1pyEQexspKc8Ns4k5SvhUV8XW97_J-w6G9mMSb4NPw Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:24:13.936480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: d8cd3210dbea46d6912c93c6d28356ae Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f could not be found. Oct 23 02:24:13.938187 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'bd81b2ca-f9cb-4bc3-a344-a92633a5d73f'} Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f could not be found. Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:13.939523 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f could not be found. Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f could not be found. Oct 23 02:24:13.944533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:13.946456 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Returning 404 to user: Instance bd81b2ca-f9cb-4bc3-a344-a92633a5d73f could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:13.946456 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9212d69f-cdda-414e-ba7d-041d67a10797 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f" status: 404 len: 111 microversion: 2.1 time: 0.078743 Oct 23 02:24:13.946456 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 606/1217] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:13 2022] GET /compute/v2.1/servers/bd81b2ca-f9cb-4bc3-a344-a92633a5d73f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:14.384280 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:14.385328 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:14.392658 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:14.393332 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:14.393921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:14.395261 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:14.395893 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:14.396323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:14.411543 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: DELETE /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f HTTP/1.1 Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:24:14.413439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.415220 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'd89425f0-1391-4e8f-9135-b292f96bbb8f'} Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:14.416156 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.418027 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.420522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:14.420522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e31b1c41-6a4a-4ea9-96ba-b17b5ba57821 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 404 len: 111 microversion: 2.1 time: 0.035182 Oct 23 02:24:14.420522 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 612/1218] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:24:14 2022] DELETE /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:14.427148 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:14.428160 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] [instance: d89425f0-1391-4e8f-9135-b292f96bbb8f] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:14.436313 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:14.436810 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:14.437245 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:14.438212 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:14.438641 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:14.439068 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:14.455348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] HTTP exception thrown: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Request method failure captured: Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f HTTP/1.1 Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKMrk94zz-n3xcoGSd-6pj_AGizE21p4hLCaMdwrotvBMhVBd-pTU45qs8M_gihhaPYNOSYUr8mm5IjAfe0tWnbPR9Z1JArDaEUzFUdCy58d-wOZXlCsOkbBSGemQ1RJW66m55buu_Itdqg7MecosRrky3dQWwdBVhPIuLs92bBtRo4 Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:24:14.456902 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/eab81e47f8d6426fbd5b50d1eb7fc14a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: eab81e47f8d6426fbd5b50d1eb7fc14a Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1183564244 Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 66975cf6d8fa417e8df429d4c89ef910 Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-AttachVolumeNegativeTest-1183564244-project Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.458340 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'd89425f0-1391-4e8f-9135-b292f96bbb8f'} Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:14.459178 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. Oct 23 02:24:14.460481 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.461607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] Returning 404 to user: Instance d89425f0-1391-4e8f-9135-b292f96bbb8f could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:14.461607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-d6473acd-1064-48ae-b740-79535870bda9 tempest-AttachVolumeNegativeTest-1183564244 tempest-AttachVolumeNegativeTest-1183564244-project] 10.222.0.23 "GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f" status: 404 len: 111 microversion: 2.1 time: 0.035369 Oct 23 02:24:14.461607 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 607/1219] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:14 2022] GET /compute/v2.1/servers/d89425f0-1391-4e8f-9135-b292f96bbb8f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:14.494402 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:14.495028 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:14.501271 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:14.501869 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:14.502411 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:14.503247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:14.503844 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:14.504432 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:14.526356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.wsgi [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] HTTP exception thrown: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Request method failure captured: Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: request: DELETE /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c HTTP/1.1 Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept: application/json Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Accept-Encoding: identity Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Connection: close Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Length: 0 Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Content-Type: application/json Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Host: 10.222.0.23 Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: Openstack-System-Scope: None Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Auth-Token: gAAAAABjVKNDHKikYXu23VSMbM8Uv3FK0IPJ8BV-XvHTQkhR-gU_ntrUIDSLgSDf4VbyaB0csCGtTcWi2whWptTEyq1CsbMUxtfeUzpAsKSmbrwY6t309FI7ZFfH267GACBGXuM3hQIom1pyEQexspKc8Ns4k5SvhUV8XW97_J-w6G9mMSb4NPw Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Id: None Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Domain-Name: None Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Identity-Status: Confirmed Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Is-Admin-Project: True Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Id: default Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Domain-Name: Default Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Project-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Role: reader,member Oct 23 02:24:14.528104 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Roles: reader,member Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-Tenant-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Id: default Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Domain-Name: Default Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Id: d8cd3210dbea46d6912c93c6d28356ae Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: X-User-Name: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: method: > Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: exception: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.529787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: action_args: {'id': 'db07175d-130c-4921-9d80-695f6a7d3d0c'} Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:14.530778 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.532754 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.534323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Returning 404 to user: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. {{(pid=118878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:14.534323 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d0d87dcb-a5b4-4dcc-ae25-6c5930a0f8cf tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "DELETE /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 404 len: 111 microversion: 2.1 time: 0.041714 Oct 23 02:24:14.536803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 613/1220] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:24:14 2022] DELETE /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:24:14.543806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:14.549214 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] [instance: db07175d-130c-4921-9d80-695f6a7d3d0c] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:14.556801 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:14.557361 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:14.557797 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:14.558518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:14.558975 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:14.559407 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:14.581270 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] HTTP exception thrown: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Request method failure captured: Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c HTTP/1.1 Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKNDHKikYXu23VSMbM8Uv3FK0IPJ8BV-XvHTQkhR-gU_ntrUIDSLgSDf4VbyaB0csCGtTcWi2whWptTEyq1CsbMUxtfeUzpAsKSmbrwY6t309FI7ZFfH267GACBGXuM3hQIom1pyEQexspKc8Ns4k5SvhUV8XW97_J-w6G9mMSb4NPw Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:24:14.591517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/10f27676e78f475fa9734f3d6f541da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 10f27676e78f475fa9734f3d6f541da5 Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-TestVolumeBootPattern-182285566 Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: d8cd3210dbea46d6912c93c6d28356ae Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-TestVolumeBootPattern-182285566-project Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.595002 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'db07175d-130c-4921-9d80-695f6a7d3d0c'} Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:24:14.595962 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. Oct 23 02:24:14.597528 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:24:14.598980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Returning 404 to user: Instance db07175d-130c-4921-9d80-695f6a7d3d0c could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:24:14.602098 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-640ff3d7-d900-48c2-86e4-daeeb2bece95 tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c" status: 404 len: 111 microversion: 2.1 time: 0.065173 Oct 23 02:24:14.604032 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 608/1221] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:14 2022] GET /compute/v2.1/servers/db07175d-130c-4921-9d80-695f6a7d3d0c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 23 02:24:16.288046 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3260c0b8-1010-43d3-bfd9-7047e4f3ad0d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] Calling method '.version_select at 0x7f9da2ede940>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:16.341420 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3260c0b8-1010-43d3-bfd9-7047e4f3ad0d tempest-TestVolumeBootPattern-182285566 tempest-TestVolumeBootPattern-182285566-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1022248569" status: 202 len: 0 microversion: 2.1 time: 0.059920 Oct 23 02:24:16.342740 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 614/1222] 10.222.0.23 () {58 vars in 1263 bytes} [Sun Oct 23 02:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1022248569 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:24:17.995725 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-464908677", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "networks": [{"uuid": "b3a34289-bbf3-495e-8f22-1842975541e7"}]}} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:18.078923 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.network.neutron [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] validate_networks() for [('b3a34289-bbf3-495e-8f22-1842975541e7', None, None, None, None, None)] {{(pid=118877) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:24:18.997188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Flavor limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:24:18.997788 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Image limits 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:24:18.998068 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Flavor pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:24:18.998493 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Image pref 0:0:0 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:24:18.999089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.virt.hardware [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:24:19.008752 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:19.010039 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:19.010768 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:19.012206 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:19.012909 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:19.013599 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:19.036061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Getting quotas for project 3f32b2691a2244adbaf9a37f6981b393. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:24:19.047380 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.quota [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Getting quotas for user 4f7ae78b38be4dee9ee5b695b05c2e3a and project 3f32b2691a2244adbaf9a37f6981b393. Resources: {'ram', 'cores', 'instances'} {{(pid=118877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:24:19.065563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Going to run 1 instances... {{(pid=118877) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:24:19.068591 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:24:19.151755 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-30fdc726-1821-427e-af87-151b586ff16f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160188 Oct 23 02:24:19.152848 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 609/1223] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:24:19.166701 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-729ad321-de3f-4ab4-8a46-689580f87643 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:19.167336 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-729ad321-de3f-4ab4-8a46-689580f87643 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:19.267518 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-729ad321-de3f-4ab4-8a46-689580f87643 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:19.279819 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-729ad321-de3f-4ab4-8a46-689580f87643 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1218 microversion: 2.1 time: 0.118456 Oct 23 02:24:19.281551 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 615/1224] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:19 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:20.318792 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:20.319458 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:20.331716 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:20.332466 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:20.333865 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:20.334955 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:20.335600 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:20.340038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:20.533561 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:20.548133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-37a93920-d6bb-4eea-a5c6-75934d37a80f tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1270 microversion: 2.1 time: 0.240272 Oct 23 02:24:20.554806 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 610/1225] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:20 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:21.574016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:21.574896 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:21.583306 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:21.591011 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:21.592240 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:21.594420 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:21.595203 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:21.595675 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:21.596115 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:21.753462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:21.769683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c2bd9ca2-26fa-4c47-b5fd-6470d7972430 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1276 microversion: 2.1 time: 0.201053 Oct 23 02:24:21.770509 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 616/1226] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:21 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:22.796850 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:22.797881 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:22.813280 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:22.814889 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:22.815971 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:22.817457 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:22.818191 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:22.819363 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:23.074085 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:23.082175 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-b94d82e9-55d2-49f6-a456-b27fd3d21a4e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.290787 Oct 23 02:24:23.082988 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 611/1227] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:22 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:23.481468 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-b674774e-aa40-41f2-a23b-e522b4f87e61 req-0e5d2e9a-75f7-4424-a1f7-b69e4c92fe16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bf4fa0-3b40-4f41-aa00-09fb44c66cc2", "tag": "5b3ab6f5-49b6-405f-9ddb-8ea847751514"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:23.546247 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b674774e-aa40-41f2-a23b-e522b4f87e61 req-0e5d2e9a-75f7-4424-a1f7-b69e4c92fe16 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:23.551303 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b674774e-aa40-41f2-a23b-e522b4f87e61 req-0e5d2e9a-75f7-4424-a1f7-b69e4c92fe16 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:23.552501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-b674774e-aa40-41f2-a23b-e522b4f87e61 req-0e5d2e9a-75f7-4424-a1f7-b69e4c92fe16 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:23.582976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-b674774e-aa40-41f2-a23b-e522b4f87e61 req-0e5d2e9a-75f7-4424-a1f7-b69e4c92fe16 service nova] Creating event network-changed:5b3ab6f5-49b6-405f-9ddb-8ea847751514 for instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 on hv-cinder-86149 Oct 23 02:24:23.592492 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-b674774e-aa40-41f2-a23b-e522b4f87e61 req-0e5d2e9a-75f7-4424-a1f7-b69e4c92fe16 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119364 Oct 23 02:24:23.593462 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 617/1228] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:24:24.108973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:24.109780 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:24.120864 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:24.124189 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:24.124944 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:24.128671 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:24.130401 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:24.131102 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:24.412802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:24.428421 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1203f69a-a448-4161-9499-d8b1fdc97ad9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.321827 Oct 23 02:24:24.429217 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 612/1229] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:24 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:25.454061 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:25.454733 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:25.460839 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:25.461321 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:25.461784 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:25.462502 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:25.463055 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:25.463628 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:25.637179 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:25.647392 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-393b521a-5156-4520-a6c4-a7199684df35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.198073 Oct 23 02:24:25.648243 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 618/1230] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:25 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:24:26.673188 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:26.673921 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:26.675995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:26.681603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:26.682413 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:26.683079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:26.683785 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:26.684238 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:26.684660 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:26.825089 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:26.834630 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-3f831a72-7402-4928-b5e8-3060bb811571 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.165369 Oct 23 02:24:26.835657 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 613/1231] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:26 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:27.861510 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:27.862235 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:27.868909 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:27.869393 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:27.869836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:27.870593 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:27.871044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:27.871474 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:27.875563 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:28.002230 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:28.009887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-d8794e71-0039-466b-b24e-777512355174 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.152156 Oct 23 02:24:28.010406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 619/1232] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:27 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:29.033999 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:29.034636 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:29.037438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=2 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:29.042970 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:29.043446 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:29.043874 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:29.044551 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:29.044995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:29.045414 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:29.060229 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=6 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:29.180084 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:29.187938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-9f7079e0-26b9-4885-8f7a-d885d888eef6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.157804 Oct 23 02:24:29.188492 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 614/1233] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:29 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:30.210744 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:30.211291 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:30.213568 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:30.219299 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:30.219777 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:30.220217 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:30.221475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:30.221930 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:30.222353 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:30.355052 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:30.363388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-00f65c68-fb73-41dc-ad46-25a82939b35a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.156573 Oct 23 02:24:30.363983 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 620/1234] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:30 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:31.387721 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:31.388978 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:31.400611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:31.401053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:31.401479 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:31.402167 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:31.402650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:31.403133 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:31.539321 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:31.546985 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-297dbcf4-7e27-4e40-ad52-b123a798a51d tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.163147 Oct 23 02:24:31.547550 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 615/1235] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:31 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:32.571433 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:32.572192 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:32.579708 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:32.580206 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:32.580650 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:32.581367 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:32.581823 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:32.582255 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:32.737075 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:32.749356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-06a0b512-4f25-4533-8577-e3f7fb75cee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.181730 Oct 23 02:24:32.750322 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 621/1236] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:32 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:32.832218 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-0920bd7c-fb84-4b31-a075-35a2437f8a81 req-8059564f-4f20-4d3a-8411-da2271c9432f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bf4fa0-3b40-4f41-aa00-09fb44c66cc2", "name": "network-vif-plugged", "status": "completed", "tag": "5b3ab6f5-49b6-405f-9ddb-8ea847751514"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:24:32.843972 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0920bd7c-fb84-4b31-a075-35a2437f8a81 req-8059564f-4f20-4d3a-8411-da2271c9432f service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:32.844449 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0920bd7c-fb84-4b31-a075-35a2437f8a81 req-8059564f-4f20-4d3a-8411-da2271c9432f service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:32.845219 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-0920bd7c-fb84-4b31-a075-35a2437f8a81 req-8059564f-4f20-4d3a-8411-da2271c9432f service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:32.856646 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-0920bd7c-fb84-4b31-a075-35a2437f8a81 req-8059564f-4f20-4d3a-8411-da2271c9432f service nova] Creating event network-vif-plugged:5b3ab6f5-49b6-405f-9ddb-8ea847751514 for instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 on hv-cinder-86149 Oct 23 02:24:32.864938 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-0920bd7c-fb84-4b31-a075-35a2437f8a81 req-8059564f-4f20-4d3a-8411-da2271c9432f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037903 Oct 23 02:24:32.865705 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 616/1237] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:24:33.772625 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:33.773231 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:33.780566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:33.781044 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:33.781478 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:33.782161 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:33.782647 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:33.783070 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:33.913242 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:33.921665 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-da3c346a-c730-440a-9661-a0715d1abbdc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1318 microversion: 2.1 time: 0.152829 Oct 23 02:24:33.922176 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 622/1238] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:33 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:24:34.945911 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:24:34.946558 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:24:34.953091 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:34.953576 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:34.954026 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:34.954728 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:24:34.955183 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:24:34.955603 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:24:34.958230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=87 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:24:35.086403 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:24:35.094619 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-75e0558c-0219-4f17-b7d2-f3e88cf12258 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1505 microversion: 2.1 time: 0.153516 Oct 23 02:24:35.095182 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 617/1239] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:24:34 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:10.373043 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4362b9d0-9aaf-4dce-a61a-e8ea2456f00c", "device": "/dev/sdb"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:10.375996 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:10.378173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=12 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:10.378921 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=22 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:10.385868 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:10.386347 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:10.386812 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:10.387511 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:10.387966 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:10.388394 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:10.655577 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-58ec80de-ade2-4aea-a069-4a9f7afa0ddb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "POST /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286368 Oct 23 02:25:10.656189 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 623/1240] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:25:10 2022] POST /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:25:38.589014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=9 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:38.589833 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=5 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:38.594296 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:38.594841 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:38.601710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.602173 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.602650 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.603334 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:38.603811 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:38.604213 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:38.691033 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lazy-loading 'services' on Instance uuid 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:25:38.768366 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-e5d4e854-4b74-4475-a1ea-eb6731b0c4fc tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "DELETE /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2/os-volume_attachments/4362b9d0-9aaf-4dce-a61a-e8ea2456f00c" status: 202 len: 0 microversion: 2.1 time: 0.180849 Oct 23 02:25:38.769056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 618/1241] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:25:38 2022] DELETE /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2/os-volume_attachments/4362b9d0-9aaf-4dce-a61a-e8ea2456f00c => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:25:39.893382 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:39.894159 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:39.898465 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:39.899054 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:39.906635 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:39.907115 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:39.907551 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:39.908241 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:39.908693 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:39.909114 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:39.935396 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:25:40.009531 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2c344082-fe2f-463d-a2b1-e4bfed1f2400 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "DELETE /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 204 len: 0 microversion: 2.1 time: 0.117329 Oct 23 02:25:40.010258 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 624/1242] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:25:39 2022] DELETE /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:25:40.019757 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:40.020464 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:40.026778 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:40.027348 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:40.027787 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:40.028480 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:40.028932 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:40.029355 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:40.157067 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:40.164710 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-bdc90f26-12a9-49b8-ba8f-9b1b2fe345e8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1511 microversion: 2.1 time: 0.150006 Oct 23 02:25:40.165271 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 619/1243] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:40 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:41.189077 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:41.189775 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:41.196221 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:41.196698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:41.197132 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:41.197811 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:41.198255 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:41.198696 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:41.343550 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:41.351879 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-0cca3495-7512-4acf-9de3-cfbaa74e2ee1 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1511 microversion: 2.1 time: 0.167536 Oct 23 02:25:41.352452 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 625/1244] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:41 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:42.375404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:42.376237 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:42.389425 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:42.390197 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:42.390844 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:42.392714 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:42.396383 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:42.396825 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:42.645751 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-e061b111-9d3f-45f9-a64b-28e8d5903c6c req-8b53d817-37f5-4a4e-bf25-26339f0799cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bf4fa0-3b40-4f41-aa00-09fb44c66cc2", "name": "network-vif-deleted", "tag": "5b3ab6f5-49b6-405f-9ddb-8ea847751514"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:42.652073 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:42.658453 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-e061b111-9d3f-45f9-a64b-28e8d5903c6c req-8b53d817-37f5-4a4e-bf25-26339f0799cf service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:42.658976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-e061b111-9d3f-45f9-a64b-28e8d5903c6c req-8b53d817-37f5-4a4e-bf25-26339f0799cf service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:42.659408 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-e061b111-9d3f-45f9-a64b-28e8d5903c6c req-8b53d817-37f5-4a4e-bf25-26339f0799cf service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:42.659911 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-89bafc92-d7eb-40eb-9ac9-ffba09699b82 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 200 len: 1511 microversion: 2.1 time: 0.289068 Oct 23 02:25:42.660518 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 620/1245] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:42 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:42.674122 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-e061b111-9d3f-45f9-a64b-28e8d5903c6c req-8b53d817-37f5-4a4e-bf25-26339f0799cf service nova] Creating event network-vif-deleted:5b3ab6f5-49b6-405f-9ddb-8ea847751514 for instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 on hv-cinder-86149 Oct 23 02:25:42.682249 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-e061b111-9d3f-45f9-a64b-28e8d5903c6c req-8b53d817-37f5-4a4e-bf25-26339f0799cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040216 Oct 23 02:25:42.683041 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 626/1246] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 23 02:25:43.689948 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:43.690782 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:43.699061 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:43.699479 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:43.699934 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:43.701151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:43.701151 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:43.701517 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:43.715891 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] HTTP exception thrown: Instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 could not be found. Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Request method failure captured: Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 HTTP/1.1 Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKXQZREsdYjEKsA6mb3pgOW_ieYujMEGd76U_KdIDSH5uuYilb2abGBYh-Ud2dT-tzXI9o-K1ZrRZ72ME4-OnxPoLLW6NRsDF2_RHhrV3kE3sqlHy3vr733eFHQqc1ba5xdYQzZIbEAyeWPuiaIdZq4RyAhGzF4LJi286hfzg-l3UaU Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 3f32b2691a2244adbaf9a37f6981b393 Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1262677819 Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:25:43.717637 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f32b2691a2244adbaf9a37f6981b393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f32b2691a2244adbaf9a37f6981b393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f32b2691a2244adbaf9a37f6981b393"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f32b2691a2244adbaf9a37f6981b393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesSnapshotTestJSON-1262677819 Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 3f32b2691a2244adbaf9a37f6981b393 Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1262677819 Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesSnapshotTestJSON-1262677819-project Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 4f7ae78b38be4dee9ee5b695b05c2e3a Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesSnapshotTestJSON-1262677819-project Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 could not be found. Oct 23 02:25:43.719542 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': '08bf4fa0-3b40-4f41-aa00-09fb44c66cc2'} Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 could not be found. Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:25:43.720790 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 could not be found. Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 could not be found. Oct 23 02:25:43.722524 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:25:43.724056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Returning 404 to user: Instance 08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:25:43.724056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-20068be4-dc05-4a80-a6a3-5bc04fc7ef42 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2" status: 404 len: 111 microversion: 2.1 time: 0.033489 Oct 23 02:25:43.724056 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 621/1247] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:43 2022] GET /compute/v2.1/servers/08bf4fa0-3b40-4f41-aa00-09fb44c66cc2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 23 02:25:54.673860 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1345290477", "imageRef": "9d561c1b-a1b7-4d40-9c32-91d8e0ff4269", "flavorRef": "452", "networks": [{"uuid": "b3a34289-bbf3-495e-8f22-1842975541e7"}]}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:25:54.682633 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:54.683278 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:54.730079 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.network.neutron [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] validate_networks() for [('b3a34289-bbf3-495e-8f22-1842975541e7', None, None, None, None, None)] {{(pid=118878) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 23 02:25:55.191298 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Flavor limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 23 02:25:55.191875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Image limits 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 23 02:25:55.192501 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Flavor pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 23 02:25:55.193083 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Image pref 0:0:0 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 23 02:25:55.193527 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.virt.hardware [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 23 02:25:55.203603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:55.204085 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:55.204713 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:55.205439 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:55.205894 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:55.206322 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:55.223277 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Getting quotas for project 3f32b2691a2244adbaf9a37f6981b393. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 23 02:25:55.227254 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.quota [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Getting quotas for user 4f7ae78b38be4dee9ee5b695b05c2e3a and project 3f32b2691a2244adbaf9a37f6981b393. Resources: {'ram', 'cores', 'instances'} {{(pid=118878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 23 02:25:55.238282 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Going to run 1 instances... {{(pid=118878) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 23 02:25:55.240689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d561c1b-a1b7-4d40-9c32-91d8e0ff4269',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 23 02:25:55.287705 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fd3d258f-90f3-481b-808b-d27f66b68f72 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618069 Oct 23 02:25:55.288356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 627/1248] 10.222.0.23 () {60 vars in 1147 bytes} [Sun Oct 23 02:25:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 23 02:25:55.299709 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c26cf306-17bf-4039-acff-3d9fe8b591ce tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:55.300388 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c26cf306-17bf-4039-acff-3d9fe8b591ce tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:55.303156 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=8 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:55.303749 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:25:55.359210 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-c26cf306-17bf-4039-acff-3d9fe8b591ce tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:55.366224 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c26cf306-17bf-4039-acff-3d9fe8b591ce tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1219 microversion: 2.1 time: 0.070583 Oct 23 02:25:55.366904 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 622/1249] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:55 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:56.389635 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-109e6c2e-50ad-44e7-a8f1-6960158cdd22 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:56.390953 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-109e6c2e-50ad-44e7-a8f1-6960158cdd22 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:56.471810 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-109e6c2e-50ad-44e7-a8f1-6960158cdd22 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:56.480018 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-109e6c2e-50ad-44e7-a8f1-6960158cdd22 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1219 microversion: 2.1 time: 0.094298 Oct 23 02:25:56.480948 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 628/1250] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:56 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:57.504312 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f3abcb01-f0ce-4b24-8567-d6b26cfe6dec tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:57.504954 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f3abcb01-f0ce-4b24-8567-d6b26cfe6dec tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:57.574290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f3abcb01-f0ce-4b24-8567-d6b26cfe6dec tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:57.581374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f3abcb01-f0ce-4b24-8567-d6b26cfe6dec tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1219 microversion: 2.1 time: 0.081166 Oct 23 02:25:57.581933 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 623/1251] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:57 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:58.604324 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-fb56accb-e754-4421-92a9-336402105c96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:58.605049 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-fb56accb-e754-4421-92a9-336402105c96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:58.659072 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-fb56accb-e754-4421-92a9-336402105c96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:58.666769 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-fb56accb-e754-4421-92a9-336402105c96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1219 microversion: 2.1 time: 0.066267 Oct 23 02:25:58.667429 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 629/1252] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:58 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:25:59.691230 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:25:59.691846 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:25:59.698995 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:59.699477 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:59.699910 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:59.700606 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:25:59.701060 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:25:59.701485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:25:59.774708 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:25:59.786475 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-fb6a3556-dea8-49f9-8045-09666566b9b3 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1223 microversion: 2.1 time: 0.099129 Oct 23 02:25:59.787209 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 624/1253] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:25:59 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:00.810572 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:00.811887 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:00.819344 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:00.819821 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:00.820437 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:00.821451 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:00.822787 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:00.823309 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:00.934241 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:00.942301 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-2b00acdb-a684-4aa8-890b-8cd5c2cc0a97 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1277 microversion: 2.1 time: 0.136994 Oct 23 02:26:00.943272 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 630/1254] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:00 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:26:01.944648 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-9ea44768-1d93-4171-b0a5-cbe2ad72d99e req-60e370d0-57de-4bc9-9e92-377c7fce5c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e6df54-88f5-424d-a36b-97e12da6f006", "tag": "562d73bb-f803-4010-97d3-49bde2db1d5a"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:26:01.957374 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9ea44768-1d93-4171-b0a5-cbe2ad72d99e req-60e370d0-57de-4bc9-9e92-377c7fce5c67 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:01.958161 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9ea44768-1d93-4171-b0a5-cbe2ad72d99e req-60e370d0-57de-4bc9-9e92-377c7fce5c67 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:01.958847 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-9ea44768-1d93-4171-b0a5-cbe2ad72d99e req-60e370d0-57de-4bc9-9e92-377c7fce5c67 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:01.974869 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-9ea44768-1d93-4171-b0a5-cbe2ad72d99e req-60e370d0-57de-4bc9-9e92-377c7fce5c67 service nova] Creating event network-changed:562d73bb-f803-4010-97d3-49bde2db1d5a for instance d5e6df54-88f5-424d-a36b-97e12da6f006 on hv-cinder-86149 Oct 23 02:26:01.981200 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:01.981722 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-9ea44768-1d93-4171-b0a5-cbe2ad72d99e req-60e370d0-57de-4bc9-9e92-377c7fce5c67 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041990 Oct 23 02:26:01.981835 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:01.982068 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 625/1255] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:26:01.989765 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:01.990397 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:01.990980 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:01.991689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:01.992143 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:01.992680 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:02.224281 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:02.232672 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-c0cf1b02-42b5-4b22-a729-2cda70195af7 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.271419 Oct 23 02:26:02.233222 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 631/1256] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:01 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:26:03.256402 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:03.257093 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:03.263711 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:03.264184 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:03.264611 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:03.265290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:03.265753 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:03.266153 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:03.398803 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:03.407432 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-22bff8fd-53f0-4815-b927-e857d44208a6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.155351 Oct 23 02:26:03.408085 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 626/1257] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:03 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:04.431011 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:04.431615 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:04.438405 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:04.438912 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:04.439347 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:04.440035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:04.440485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:04.440911 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:04.569035 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:04.577566 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-5d116abf-12b1-49e2-b77f-793f5e27ea35 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.150459 Oct 23 02:26:04.578146 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 632/1258] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:04 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:05.600470 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:05.601085 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:05.608563 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:05.609046 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:05.609485 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:05.610177 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:05.610665 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:05.611094 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:05.744913 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:05.752554 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-668a28cf-a37a-4e0c-8bd3-60fd34940123 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.156033 Oct 23 02:26:05.753110 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 627/1259] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:05 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:06.775331 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:06.776071 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:06.778475 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=2 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:06.784059 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:06.784533 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:06.784964 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:06.785649 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:06.786128 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:06.786577 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:06.912902 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:06.920954 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-1d682cd5-bc59-4aed-9167-a65243066b96 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.149622 Oct 23 02:26:06.921516 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 633/1260] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:06 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:07.943746 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:07.944350 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:07.946723 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell0:SELECT=4 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:07.952471 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:07.952943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:07.953373 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:07.954047 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:07.954515 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:07.954963 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:08.094009 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:08.101519 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5f9c5e0f-e4f3-4ee0-8dd5-d859afcda158 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.161621 Oct 23 02:26:08.102090 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 628/1261] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:07 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:26:09.124803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:09.125428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:09.127984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell0:SELECT=10 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:09.134683 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:09.135316 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:09.136000 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:09.137487 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:09.138234 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:09.138698 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:09.392240 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:09.399803 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-8ed71561-321a-4c72-99d0-ceff56f459df tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.278890 Oct 23 02:26:09.400369 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 634/1262] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:09 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:10.423220 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:10.423834 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:10.431053 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:10.431538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:10.431980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:10.432671 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:10.433146 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:10.433571 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:10.567136 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:10.575462 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-60734ed2-3151-4bb4-9c6c-5d93c609a9d4 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.156356 Oct 23 02:26:10.576100 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 629/1263] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:10 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:11.599941 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:11.600623 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:11.607906 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:11.608383 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:11.608827 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:11.609686 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:11.609976 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:11.610508 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:11.755240 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:11.763786 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-3cf5252c-f924-428b-96f0-96e34389e7f6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.168106 Oct 23 02:26:11.764485 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 635/1264] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:11 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:12.786731 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:12.787331 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:12.794575 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:12.795249 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:12.795714 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:12.796404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:12.796860 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:12.797283 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:12.929365 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:12.937250 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-f8c1bcd9-da77-4dad-82a7-9e435eb64a41 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.154403 Oct 23 02:26:12.937813 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 630/1265] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:12 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:13.959428 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:13.959962 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:13.966772 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:13.967246 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:13.967678 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:13.968356 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:13.968801 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:13.969219 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:14.098701 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:14.106345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-bd1a4a12-56b3-4f14-a9b5-795cc42d9af8 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.150867 Oct 23 02:26:14.107528 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 636/1266] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:13 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:14.146258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [req-5b08ad44-635f-4b38-a81e-97626a5bab31 req-bc500b4b-1dbc-4429-8548-63a23a668e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e6df54-88f5-424d-a36b-97e12da6f006", "name": "network-vif-plugged", "status": "completed", "tag": "562d73bb-f803-4010-97d3-49bde2db1d5a"}]} {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:26:14.156751 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5b08ad44-635f-4b38-a81e-97626a5bab31 req-bc500b4b-1dbc-4429-8548-63a23a668e80 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:14.157302 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5b08ad44-635f-4b38-a81e-97626a5bab31 req-bc500b4b-1dbc-4429-8548-63a23a668e80 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:14.157802 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [req-5b08ad44-635f-4b38-a81e-97626a5bab31 req-bc500b4b-1dbc-4429-8548-63a23a668e80 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:14.172048 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.compute.server_external_events [req-5b08ad44-635f-4b38-a81e-97626a5bab31 req-bc500b4b-1dbc-4429-8548-63a23a668e80 service nova] Creating event network-vif-plugged:562d73bb-f803-4010-97d3-49bde2db1d5a for instance d5e6df54-88f5-424d-a36b-97e12da6f006 on hv-cinder-86149 Oct 23 02:26:14.176943 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [req-5b08ad44-635f-4b38-a81e-97626a5bab31 req-bc500b4b-1dbc-4429-8548-63a23a668e80 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 Oct 23 02:26:14.177533 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 631/1267] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:26:15.129970 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:15.130635 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:15.137110 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:15.137601 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:15.138191 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:15.138985 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:15.139444 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:15.139874 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:15.269204 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:15.276715 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-e6b4d4dc-5cdb-4e7c-a75b-adab94b140e9 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1319 microversion: 2.1 time: 0.150701 Oct 23 02:26:15.277285 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 637/1268] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:15 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:16.301038 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:16.301770 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:16.309076 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:16.309556 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:16.310538 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:16.311273 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:16.311980 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:16.312408 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:16.442271 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:16.450101 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-a8652e1f-4056-43fb-9cf1-910f8cea6c3a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1507 microversion: 2.1 time: 0.153845 Oct 23 02:26:16.451745 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 632/1269] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:16 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:16.472721 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7853969f-799a-4523-a877-ad650ab3518d", "device": "/dev/sdb"}} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:26:16.475255 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:16.481622 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:16.482135 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:16.482620 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:16.483313 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:16.483770 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:16.484198 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:16.739407 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-aff038e8-db4d-4880-9c11-3df550b0efb6 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "POST /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270073 Oct 23 02:26:16.740019 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 638/1270] 10.222.0.23 () {60 vars in 1323 bytes} [Sun Oct 23 02:26:16 2022] POST /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:26:38.158371 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:38.159018 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:38.160973 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_api:SELECT=26 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:38.161800 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG dbcounter [-] [118877] Writing DB stats nova_cell1:SELECT=46 {{(pid=118877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:38.167458 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:38.167941 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:38.168376 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:38.169058 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:38.169507 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:38.169935 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:38.449306 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.objects.instance [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lazy-loading 'services' on Instance uuid d5e6df54-88f5-424d-a36b-97e12da6f006 {{(pid=118877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 23 02:26:38.524861 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-c9c53b59-7712-4b11-b7ed-c05cd76dcccb tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006/os-volume_attachments/7853969f-799a-4523-a877-ad650ab3518d" status: 202 len: 0 microversion: 2.1 time: 0.370439 Oct 23 02:26:38.525438 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 633/1271] 10.222.0.23 () {58 vars in 1416 bytes} [Sun Oct 23 02:26:38 2022] DELETE /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006/os-volume_attachments/7853969f-799a-4523-a877-ad650ab3518d => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 23 02:26:39.644581 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:39.645173 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:39.647895 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:39.648689 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG dbcounter [-] [118878] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 02:26:39.655388 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:39.655875 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:39.656318 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:39.657016 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:39.657476 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:39.657903 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:39.685560 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Going to try to terminate instance {{(pid=118878) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 23 02:26:39.763297 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-9adc8cfe-ca1b-4bdd-997a-2d93298d7419 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 204 len: 0 microversion: 2.1 time: 0.122460 Oct 23 02:26:39.763830 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 639/1272] 10.222.0.23 () {58 vars in 1239 bytes} [Sun Oct 23 02:26:39 2022] DELETE /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 23 02:26:39.772904 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:39.773604 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:39.779858 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:39.780338 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:39.780772 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:39.781458 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:39.781913 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:39.782339 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:39.910981 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:39.919295 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-5c85d599-9831-498c-91af-dd8d4802635a tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1513 microversion: 2.1 time: 0.151066 Oct 23 02:26:39.919856 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 634/1273] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:39 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 23 02:26:40.943984 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:40.944603 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.compute.api [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118878) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:40.951023 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:40.951506 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:40.951939 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:40.952634 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:40.953084 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:40.953508 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:41.182226 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.policy [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118878) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:41.189836 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [None req-4860006e-aa36-4227-966d-fea3bda3e52e tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1513 microversion: 2.1 time: 0.250587 Oct 23 02:26:41.190406 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 640/1274] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:40 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:42.213258 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:42.214564 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:42.221104 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:42.221585 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:42.222014 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:42.222945 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:42.223466 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:42.223827 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:42.316351 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.policy [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7ae78b38be4dee9ee5b695b05c2e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f32b2691a2244adbaf9a37f6981b393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118877) authorize /opt/stack/nova/nova/policy.py:199}} Oct 23 02:26:42.324290 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-8fad61b7-e5b1-4df2-ad5d-ff55ccc6363c tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 200 len: 1471 microversion: 2.1 time: 0.114926 Oct 23 02:26:42.325404 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 635/1275] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:42 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 1471 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 23 02:26:42.383597 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG nova.api.openstack.wsgi [req-aecfef6c-e53f-49d2-be1d-0406ee077025 req-a2cae248-5603-4c92-9ef1-789866c55493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e6df54-88f5-424d-a36b-97e12da6f006", "name": "network-vif-deleted", "tag": "562d73bb-f803-4010-97d3-49bde2db1d5a"}]} {{(pid=118878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 23 02:26:42.393837 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-aecfef6c-e53f-49d2-be1d-0406ee077025 req-a2cae248-5603-4c92-9ef1-789866c55493 service nova] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:42.394345 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-aecfef6c-e53f-49d2-be1d-0406ee077025 req-a2cae248-5603-4c92-9ef1-789866c55493 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:42.394809 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: DEBUG oslo_concurrency.lockutils [req-aecfef6c-e53f-49d2-be1d-0406ee077025 req-a2cae248-5603-4c92-9ef1-789866c55493 service nova] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:42.406818 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.compute.server_external_events [req-aecfef6c-e53f-49d2-be1d-0406ee077025 req-a2cae248-5603-4c92-9ef1-789866c55493 service nova] Creating event network-vif-deleted:562d73bb-f803-4010-97d3-49bde2db1d5a for instance d5e6df54-88f5-424d-a36b-97e12da6f006 on hv-cinder-86149 Oct 23 02:26:42.413838 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: INFO nova.api.openstack.requestlog [req-aecfef6c-e53f-49d2-be1d-0406ee077025 req-a2cae248-5603-4c92-9ef1-789866c55493 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034046 Oct 23 02:26:42.415688 dv-cinder-861491-5-iscsi devstack@n-api.service[118878]: [pid: 118878|app: 0|req: 641/1276] 10.222.0.23 () {64 vars in 1317 bytes} [Sun Oct 23 02:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 23 02:26:43.347463 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Calling method '>' {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 23 02:26:43.348010 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.compute.api [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] [instance: d5e6df54-88f5-424d-a36b-97e12da6f006] Fetching instance by UUID {{(pid=118877) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 23 02:26:43.354597 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:43.355079 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:43.355509 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:43.356186 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Acquiring lock "b9a91453-b148-423b-846a-e9f010e30c38" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 23 02:26:43.356633 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 23 02:26:43.357052 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG oslo_concurrency.lockutils [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Lock "b9a91453-b148-423b-846a-e9f010e30c38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 23 02:26:43.370638 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.wsgi [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] HTTP exception thrown: Instance d5e6df54-88f5-424d-a36b-97e12da6f006 could not be found. Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Request method failure captured: Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: request: GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 HTTP/1.1 Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept: application/json Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Accept-Encoding: identity Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Connection: close Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Length: 0 Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Content-Type: application/json Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Host: 10.222.0.23 Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: Openstack-System-Scope: None Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: User-Agent: python-urllib3/1.26.12 Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Auth-Token: gAAAAABjVKXQZREsdYjEKsA6mb3pgOW_ieYujMEGd76U_KdIDSH5uuYilb2abGBYh-Ud2dT-tzXI9o-K1ZrRZ72ME4-OnxPoLLW6NRsDF2_RHhrV3kE3sqlHy3vr733eFHQqc1ba5xdYQzZIbEAyeWPuiaIdZq4RyAhGzF4LJi286hfzg-l3UaU Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Id: None Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Domain-Name: None Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Identity-Status: Confirmed Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Is-Admin-Project: True Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Id: default Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Domain-Name: Default Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Id: 3f32b2691a2244adbaf9a37f6981b393 Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1262677819 Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Role: reader,member Oct 23 02:26:43.372253 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Roles: reader,member Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f32b2691a2244adbaf9a37f6981b393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3f32b2691a2244adbaf9a37f6981b393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3f32b2691a2244adbaf9a37f6981b393"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3f32b2691a2244adbaf9a37f6981b393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant: tempest-VolumesSnapshotTestJSON-1262677819 Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Id: 3f32b2691a2244adbaf9a37f6981b393 Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1262677819 Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User: tempest-VolumesSnapshotTestJSON-1262677819-project Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Id: default Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Domain-Name: Default Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Id: 4f7ae78b38be4dee9ee5b695b05c2e3a Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: X-User-Name: tempest-VolumesSnapshotTestJSON-1262677819-project Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: method: > Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: exception: Instance d5e6df54-88f5-424d-a36b-97e12da6f006 could not be found. Oct 23 02:26:43.374050 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: action_args: {'id': 'd5e6df54-88f5-424d-a36b-97e12da6f006'} Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: {{(pid=118877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e6df54-88f5-424d-a36b-97e12da6f006 could not be found. Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 23 02:26:43.375117 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e6df54-88f5-424d-a36b-97e12da6f006 could not be found. Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e6df54-88f5-424d-a36b-97e12da6f006 could not be found. Oct 23 02:26:43.376824 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: ERROR nova.api.openstack.wsgi Oct 23 02:26:43.378291 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: DEBUG nova.api.openstack.wsgi [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] Returning 404 to user: Instance d5e6df54-88f5-424d-a36b-97e12da6f006 could not be found. {{(pid=118877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 23 02:26:43.378291 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: INFO nova.api.openstack.requestlog [None req-1ae1c6e8-4fe2-4d68-9793-fd6dcc14fb19 tempest-VolumesSnapshotTestJSON-1262677819 tempest-VolumesSnapshotTestJSON-1262677819-project] 10.222.0.23 "GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006" status: 404 len: 111 microversion: 2.1 time: 0.030092 Oct 23 02:26:43.378291 dv-cinder-861491-5-iscsi devstack@n-api.service[118877]: [pid: 118877|app: 0|req: 636/1277] 10.222.0.23 () {58 vars in 1236 bytes} [Sun Oct 23 02:26:43 2022] GET /compute/v2.1/servers/d5e6df54-88f5-424d-a36b-97e12da6f006 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)